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PART- 1 


Introduction : Algorithms, Analyzing Algorithms, Complexity of 
Algorithms. 











Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 1.1. | What do you mean by algorithm ? Write the 
characteristics of algorithm. 


Answer | 


1. Analgorithm is aset ofrules for carrying out calculation either by hand 
or on machine. 

2. Itisa finite step-by-step procedure to achieve a required result. 

3. Itisasequence of computational steps that transform the input into the 

output. 

An algorithm is a sequence of operations performed on data that have to 

be organized in data structures. 

Characteristics of algorithm are : 

1. Input and output: The algorithm must accept zero or more inputs 
and must produce at least one output. 

2. Definiteness : Each step of algorithm must be clear and unambiguous. 

3. Effectiveness: Every step must be basic and essential. 

4, Finiteness : Total number of steps used in algorithm should be finite. 


Que 1.2. | What do you mean by analysis or complexity of an 
algorithm ? Give its types and cases. 


Answer | 


Analysis/complexity of an algorithm : 

The complexity of an algorithm is a function g(n) that gives the upper 

bound of the number of operation (or running time) performed by an 

algorithm when the input size is n. 

Types of complexity : 

1. Space complexity : The space complexity of an algorithm is the amount 
of memory it needs to run to completion. 

2. Time complexity : The time complexity of an algorithm is the amount 
of time it needs to run to completion. 

Cases of complexity : 

1. Worst case complexity : The running time for any given size input 
will be lower than the upper bound except possibly for some values of 
the input where the maximum is reached. 


> 
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2. Average case complexity : The running time for any given size input 
will be the average number of operations over all problem instances 
for a given size. 

3. Best case complexity : The best case complexity of the algorithm is 
the function defined by the minimum number of steps taken on any 
instance of size n. 


PART-2 


Growth of Functions, Performance Measurements. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 1.3. | What do you understand by asymptotic notations ? 


Describe important types of asymptotic notations. 
OR 
Discuss asymptotic notations in brief. 


Answer | 


1. Asymptotic notation is a shorthand way to represent the fastest possible 
and slowest possible running times for an algorithm. 

2. Itisaline that stays within bounds. 

3. These are also referred to as ‘best case’ and ‘worst case’ scenarios and 
are used to find complexities of functions. 

Notations used for analyzing complexity are : 

1. ©-Notation (Same order) : 





Ng 
f(n) = © (g(n)) 
Fig. 1.3.1. 


a. This notation bounds a function within constant factors. 
b. We say f(n) = Og(n) if there exist positive constants ny, c, and cy 
such that to the right of n, the value of fin) always lies between 
c,g(n) and c, g(n) inclusive. 
2. O-Notation (Upper bound): 
a. Big-oh is formal method of expressing the upper bound of an 
algorithm’s running time. 
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b. It is the measure of the longest amount of time it could possibly 
take for the algorithm to complete. 

c. More formally, for non-negative functions, f(n) and g(n), if there 
exists an integer n, and a constant c > 0 such that for all integers 
N2No. 

f (n) < eg(n) 
d. Then, f(n) is big-oh of g(n). This is denoted as : 
f (n) € O(g()) 
i.e., the set of functions which, as n gets large, grow faster than a 
constant time f (7). 


cg(n) 


f(n) 


n 
M9 f(n) = O(g(n)) 
Fig. 1.3.2. 
3. Q-Notation (Lower bound) : 
a. This notation gives a lower bound for a function within a constant 
factor. 
b. We write f(x) = Q g(n)) ifthere are positive constants n, and c such 
that to the right of), the value of f(7) always lies on or above cg(n). 
f(n) 


cg(n) 


| 
i] 
i] 
n 
No 
f(n) = Q (g(n)) 
Fig. 1.3.3. 

4. Little-oh notation (0) : It is used to denote an upper bound that is 
asymptotically tight because upper bound provided by O-notation is 
not tight. 

o(g(n)) = {f(n) : for any positive constant c > 0, if aconstant n)>0 such 
that 0 < f(n) < eg(n) ¥ n>np} 

5. Little omega notation (@) : It is used to denote lower bound that is 
asymptotically tight. 

o(g(n)) = (fin): For any positive constant c > 0, if a constant n, > 0 such 
that 0 <cg(n) < Ain) ¥ n >n)} 











Design and Analysis of Algorithms 1-5 B (CS/IT-Sem-5) 





Que 1.4. | If f(n) = 100 * 2” + n> +n, then show that f(n) = O(2”). 
If fin) = 100* 2" +8 +n 


Answer | 
For n®>n 


100 * 2°4+n5+n< 100* 2% 4+n54+n5 
< 100 * 2” + 2n5 


For 2”>n° 
100 * 2° 4+ n° +n< 100 * 27+ 2.2” 
< 102 * 2” [% n<1,n)= 23] 
Thus, fin) = O(2") 


Que 1.5. | Write Master’s theorem and explain with suitable 


examples. 


Answer 


| 


Master’s theorem : 
Let T(n) be defined on the non-negative integers by the recurrence. 


T(n) = aT (2) + fin) where a > 1, b > 1 are constants 


a = Number of sub-problems in the recursion 
1/b = Portion of the original problem represented by each sub- 


problem 
fin) = Cost of dividing the problem and the cost of merging the 
solution 
Then T(n) can be bounded asymptotically as follows : 
Case 1: 
If it is true that : fin) = O(n ¢ -£) for E > 0 
It follows that : T(n) = © (nls 2) 
Example: T(n) =8T (2) + 1000n2 


In the given formula, the variables get the following values : 
a= 8,b =2, f(n) = 1000n?, log, a = log,® = 3 
nlogd a niog2 8 ns 

fin) = O(n!e86 a -E) = O(n3 - E) 
For E = 1, we get 

fin) = O(n3 -1) = O(n?) 
Since this equation holds, the first case of the Master’s theorem applies to the 
given recurrence relation, thus resulting solution is 

T(n) = © (n!°8 4) = @(n3) 
Case 2: 
If it is true that : fin) = © (nies 2) 
It follows that : T(n) = © (n!"86 ¢ Jog(n)) 
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Example: 
n 
T(n) = ar(2| +n 


In the given formula, the variables get the following values : 
a= 2, b =2, f(n) =n, log,a = log,2 = 1 
nlogd a niog2 2 = n 

fin) = O(n® 2) = O(n) 
Since this equation holds, the second case of the Master’s theorem applies to 
the given recurrence relation, thus resulting solution is : 

T(n) = O(n!’2 ¢ log(n)) = O(n log n) 
Case 3: 
If it is true that : fin) = Qe 4+#) for E> 0 
and if it is also true that : 


ifaf (2) <cf(n) for a, c < 1 and all sufficiently large n 


It follows that : T(n) = O(f(n)) 
n 
Example: T(n) = 2T (2) +n? 


In the given formula, the variables get the following values : 
a= 2,b=2, fin) =n?, log, a = log, 2=1 
niogd a = niog2 2 =n 

fin) = Q(nloee at E) 
For E = 1 we get 

fn) = Q¢n1* 3) = Qn?) 
Since the equation holds, third case of Master’s theorem is applied. 
Now, we have to check for the second condition of third case, if it is true 
that : 


n 
af (2) <c fin) 
If we insert once more the values, we get : 


n : 1 
2 (2) <en?> gm sen? 


If we choose c = 5 , itis true that : 


sm < sm yvyn21 

So, it followsthat: T(n) = © (fin)) 

If we insert once more the necessary values, we get : 
T(n) € O(n?) 


Thus, the given recurrence relation T(n) was in O(n”). 


Que 1.6. | The recurrence T(n) = 7T(n/2) + n? describe the running 


time of an algorithm A. A competing algorithm A has a running 
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time T'(n) = aT’ (n/4) + n?. What is the largest integer value for aA’ is 


asymptotically faster than A ? AKTU 2017-18, Marks 10 
Answer | 


Given that : 


T(n) = (2) +n? (1.6.1) 


T(n) = ar'(”) +n? (1.6.2) 
Here, eq. (1.6.1) defines the running time for algorithm A and eq. (1.6.2) 
defines the running time for algorithm A’. Then for finding value of a for 
which A’ is asymptotically faster than A we find asymptotic notation for the 
recurrence by using Master’s method. 


Now, compare eq. (1.6.1) by T(n) = ar”) +f(n) 


we get, a=7 
b=2 
fin) = n? 
nse = n'827 = 7281 
Now, apply cases of Master’s, theorem as : 
Case 1: fin) = O(n'"®"*) 
=> fn) = O (n?2:81-£) 
=> fin) = O (n2:81- 9.81) 
> fin) = O (n?) 
Hence, case 1 of Master’s theorem is satisfied. 
Thus, T(n) = 0(n'*) 
> T(n) = 0 (n281) 


Since recurrence given by eq. (1.6.1) is asymptotically bounded by 
6-notation by which is used to show optimum time we have to show that 
recurrence given by eq. (1.6.2) is bounded by Q-notation which shows 
minimum time (best case). 

For the use satisfy the case 3 of Master theorem, let a = 16 


T(n) = 16r"() +n? 


=> a=16 
b=4 
fn) = n? 


Q(n'8%* Fy = Q(n?2 +E) 
Hence, case 3 of Master’s theorem is satisfied. 
> T(n) = 0 (fin)) 
=> T(n) = 0 (n?) 
Therefore, this shows that A’ is asymptotically faster than A when 
a=16. 
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Que 1.7. | The recurrence T(n) = 7T(n/3) + n? describes the running 


time of an algorithm A. Another competing algorithm B has a 
running time of S(n) = a S(n/9) + n?. What is the smallest value of a 
such that B is asymptotically faster than A ? 


AKTU 2018-19, Marks 10 
Answer | 


Given that : 


T(n) = m1(2) +n? A171) 


S'(n) = as(2) +n” (1.7.2) 


Here, eq. (1.7.1) defines the running time for algorithm A and eq. (1.7.2) 
defines the running time for algorithm B. Then for finding value ofa for which 
Bisasymptotically faster than.A we find asymptotic notation for the recurrence 
by using Master’s method. 


Now, compare eq. (1.7.1) with T(n) = ar”) + f(n) 


we get, a=T7, b=8 
fn) = n? 

noe = 8s" = 7281 
Now, apply cases of Master’s, theorem as : 
Case 3: fin) = O (n'"**) 
=> fin) =O (n1.77 +e) 
=> fin) = O (n1.77 + 0.23) 
> fin) = O (n?) 
Hence, case 3 of Master’s theorem is satisfied. 
Thus, T(n) = 0 fin) 
> T(n) = 0 (n?) 


Since recurrence (1) is asymptotically bounded by 0-notation which is 
used to show optimum time we have to show that recurrence given by 
eq. (1.7.2) is bounded by Q-notation which shows minimum time (best 
case). 

For the use satisfy the case 2 of Master theorem, Guess a = 81 


S'(n) = fn) = 81 s (2) +n 
= a=81, b=9 
fin) = 78981 


fin) = Q(n'™*) = O(n?) 
Hence, case 2 of Master’s theorem is satisfied. 


> T(n) = 0 (n'®* log n) 
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=> T(n) = 0 (n? log n) 
Therefore, this shows that B is asymptotically faster than A when 
a=81. 


Que 1.8. | Solve the following recurrences : 


T(n) = T( Jn ) + O(log n) 


Answer | 


T(n) = T Jn ) + Olog n) .(1.8.1) 
m = logn 
Let n=2”™ 
nl2 = gmi2 ...(1.8.2) 
Put value of Jn in eq. (1.8.1) we get 
T(2™) = T(2”!*) + Odog 2”) (1.8.3) 
x(m) = T(2”) ...(1.8.4) 


Putting the value of x(m) in eq. (1.8.3) 


x(m) = (2) + O(m) (1.8.5) 


Solution of eq. (1.8.5) is given as 
a=1, b=2, fin) =O(m) 
m08% = mlosel + # where E = 1 
x(m) = O(log m) 
T(n) = O(log log n) 


Que 1.9. | 


i. Solve the recurrence T (n) = 2T(n/2) + n?+2n+1 
ii. Prove that worst case running time of any comparison sort 


is Q (n log n). AKTU 2019-20, Marks 07 
Answer | 
i. 


T (n) = 2T(n/2) +n? + 2n+1% ar (2) +n? 


Compare it with T(n) = aT (2) + f(n) 

we have, a=2,b=2, fn) =n? 

Now, we apply cases for Master’s theorem. 
180% = n 822 =n 

This satisfies case 3 of Master’s theorem. 


an fin) = Q (782+ £) a(n! +) 


=Q (n't) where E = 1 
= Q (n?) 
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2 
Again 2) <c fin) (1.9.1) 
eq. (1.9.1) is true for c = 2 
=> T(n) = 0 (f(n)) 
> T(n) = 0 fin?) 


Let T(n) be the time taken by merge sort to sort any array of n elements. 


Therefore, T(n) = 7(|2) + (|=) + g(n) 


where g(n) € O(n) 
This recurrence, which becomes : 


T(n) = 2T (2) + g(n) 


when n is even is a special case of our general analysis for divide-and 
conquer algorithms. 


Compare the above given recurrence with T(n) = aT (2) + f(n) 


we get a=2 
b=2 
fin) = g(n) 
Now we find, nC? _ poe? _ lin 


> fin) = O(n) 
i.e., case 2 of Master’s theorem applied then 
T(n) = 2(n!8* log n) 
=> T(n) = Q (n log n) 
Hence, the worst case running time of merge sort is Q(n log 7). 


Que 1.10. | What do you mean by recursion ? Explain your answer 


with an example. 


Answer | 


1. 


2. 


3. 


Recursion is a process of expressing a function that calls itself to perform 

specific operation. 

Indirect recursion occurs when one function calls another function that 

then calls the first function. 

Suppose P is a procedure containing either a call statement to itself or 

acall statement to a second procedure that may eventually result ina 

call statement back to the original procedure P. Then Pis called recursive 

procedure. 

A recursive procedure must have the following two properties : 

a. There must be certain criteria, called base criteria, for which the 
procedure does not call itself. 
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b. Each time the procedure does call itself, it must be closer to the 
criteria. 


5. A recursive procedure with these two properties is said to be well- 
defined. 


For example : 
The factorial function may also be defined as follows : 
a. Ifn=0,thenn!=1. 


Here, the value of n! is explicitly given when n = 0 (thus 0 is the 
base value). 


b. Ifn>0, thenn! =n. (n—-1)! 


Here, the value of n! for arbitrary n is defined in terms of a smaller 
value of n which is closer to the base value 0. 


Observe that this definition of n! is recursive, since it refers to itself when it 
uses (n — 1)! 


Que 1.11. | What is recursion tree ? Describe. 


Answer | 


1. Recursion tree is a pictorial representation of an iteration method, 
which is in the form of a tree, where at each level nodes are expanded. 

2. Inarecursion tree, each node represents the cost of asingle subproblem. 

3. Recursion trees are particularly useful when the recurrence describes 
the running time of a divide and conquer algorithm. 


4. A-recursion tree is best used to generate a good guess, which is then 
verified by the substitution method. 
5. Itisamethod to analyze the complexity of an algorithm by diagramming 


the recursive function calls in the form of tree. 


Que 1.12. | Solve the recurrence : 


T(n) = T(n - 1) + T(n - 2) +1, when T(0) = 0 and 
T()=1. 


Answer 


| 


Tin) = Tin-1) + Tin- 2) +1 
At k* level, T(1) will be equal to 1 


when, n—-k=1 
k=n-1 
= 294214974 000. gk 
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T(n) 
T(n —1) T(n — 2) 1 2°=1 
T(n — 2) on 1 — 3) Tin—4) 1 —p 2la2 


FNS ee el 


Tin = 3) a 4) 1 Te =-4) Tw=5) 1 To —4) Tin—5) 1 «... — > 22=4 


T(n — k) —» 2k 


no O¢gpn-1 _ 
‘Sum of n terms of geometric progression = | = a 
fro me 


= 2"-1_1=0(2") 


Que 1.13. | Solve the following recurrences : 


T(n) = T(n/2) + T(n/4) + T(n/8) +7 


AKTU 2019-20, Marks 07 





T(n) = noe ves + log n times 
= Q (n log n) 
— | Ls, n 
(5) 7n 
(3) S 
log n 


/ 


(Z) (s) (ze) (8) Ge) (32) (a6) (32) (6a) e 
JINJIN IN ZINN IN ZIN ZINN 


Que 1.14. | Use a recursion tree to give an asymptotically tight 











Ie 


solution to the recurrence T(n) = T(an) + T((1 - a)n) + en, where a is 
a constant in the range 0 < a <1 and c > 0 is also a constant. 


AKTU 2018-19, Marks 07 


swer 


| 


T(n) = Tian) + T(1 — a)n) + en 
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Recursion tree : 
Cost 


can (1 - a)en —__________» cn 


a 


c(l-a)an c(l-a)an ———» cn 





ca“n c(l—a)an 

/\ /N\ IN /X\ +n 

T(1) T(1) T(1) T(1) (h+ D times 
Assuming T(1) = 1 
So cl-akn=1 


1 1y 
cn = ——— =| ——— 
d-—a)’ |1-a 


1 
log (n)=k log (4) 


k= TOE Sigs _ (en) 


1 
] l-a 
clrery 


So, Total cost =cn+cn+.... (k +1) times = cn(k + 1) 
log , (cn) 


l-a 


Time complexity = ae log , en = a log , "| 


l-a l-a 


Que 1.15. | Solve the following by recursion tree method 
T(n) =n + T(n/5) + T(4n/5) 


AKTU 2017-18, Marks 10 


= cn X 


Answer 
Tn) = NA NANA cscs + log n times = Q (n log n) 

n ———— 1: 
ae ae 

oe 28) ———— i 
5 5 

i i log n 
fas} (8) as} Eas] > 
25 5 5 5 a 
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PART-3 


Sorting and Order Statistic : Shell Sort, Quick Sort. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 1.16. | Explain shell sort with example. 


Answer | 


1. Shell sort is a highly efficient sorting algorithm and is based on insertion 
sort algorithm and we can code it easily. 
2. Itroughly sorts the data first, moving large elements towards one end 
and small elements towards the other. 
3. Inshell sort several passes over the data is performed. 
4. After the final pass, the data is fully sorted. 
5. The shell sort does not sort the data itself; it increases the efficiency of 
other sorting algorithms. 
Algorithm : 
Input: An array a of length n with array elements numbered 0 to n — 1. 
1. ine < round (n/2) 
2. while inc >0 
3. fori=incton-1 
temp < ali] 
jel 
while j > inc and a [j— inc] > temp 
aly] < alj —ine] 
jJ<Jj-—ine 
alj] < temp 
4. ine < round (inc/2.2) 
For example : 


[a5] 35] 5] 20] «5 [0] co] 65] 50] 50] 10] 5) 


The distance between the elements to be compared is 3. The subfiles generated 
with the distance of 3 are as follows : 


Subfile 1 a[0] a[3] al6] al9] a[12] 
Subfile 2 a[1] a[4] a[7] a[10] 
Subfile 3 a[2] al5] a[8] a[11] 


Input to pass 1 with distance = 3 
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[as [a8 [5 [m0 [05 [oo [oo [os [90 [a0 [oo [| 
a ee ee We ee ee ee 










(a) 
Output of pass 1 is input to pass 2 and distance = 2 


[a0] 05 [0] a5 [a0] 75 [50 [96 [75 [oo [os [oo 
L A [| aA T~, A TT A T{ A T{ 4 J 
ae eee eee ee ee 





(b) 
Output of pass 2 is input to pass 3 and distance = 1 


fio] os] 20] 36 [30] «5] 50] 75] 65] 50] 75] vo] 5 
Pp | ~ | | {| { | { {| Jf J 4 





(c) 
Output of pass 3 


[|=] [s |e] [3 [a] =] = [a] o) 
(d) 


Fig. 1.16.1. 


Que 1.17. | Describe any one of the following sorting techniques : 


i. Selection sort 
ii. Insertion sort 


Answer | 


i. Selection sort (A): 

n < length [A] 

for j<1ton-1 

smallest <j 
fori<c-j+l1lton 

if A [i] < A [smallest] 

then smallest <i 

exchange (A [j], A [smallest]) 
meEebion _Sort(A): 

for j < 2 to length[A] 

do key < Aly] 

Insert A[j] into the sorted sequence A[1J..... j— 1] 
i<cj-1 

while i > 0 and A[i] > key 

do Afi + 1] — Ali] 

i<i-1 

Ali + 1] < key 


pA So PR ONE 


ii. 


SABA PRwWNE 
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Que 1.18. | Write non-deterministic algorithm for sorting. 


AKTU 2016-17, Marks 10 


Answer 


| 


Non-deterministic algorithms are algorithm that, even for the same input, 
can exhibit different behaviours on different runs, iterations and executions. 
NSORT(4,B): 

fori =1tondo 

j=choice(1...7) 

if Bly] != 0 then failure 

BU] =Alzl 

endfor 

fori =1ton—1do 

if Bli] < Bli + 1] then failure 

endfor 

.  print(B) 

10. success 


Que 1.19. | Explain the concepts of quick sort method and analyze 
its complexity with suitable example. | AKTU 2016-17, Marks 10 
Answer | 


Quick sort : 

Quick sort works by partitioning a given array Alp ... r] into two non-empty 
subarray Alp ...qg—1] andA [q +1... r] such that every key in Alp ...q—1] is 
less than or equal to every key in Alg + 1... r]. Then the two subarrays are 
sorted by recursive calls to quick sort. 

Quick_Sort (A, p, r) 

1. Ifp<rthen 

2. q< Partition (A, p, r) 

3. Recursive call to Quick_Sort (A, p, g—-1) 

4. Recursive call to Quick_Sort (A, g + 1,7) 

As afirst step, Quick sort chooses as pivot one of the items in the array to be 
sorted. Then array is partitioned on either side of the pivot. Elements that 
are less than or equal to pivot will move toward the left and elements that are 
greater than or equal to pivot will move toward the right. 

Partition (A, p, r) 

1 x<Alr] 

i<cp-1l 

forj<ptor-1 

do if A[j] <x 

theni<i+1 

then exchange Ali] © A[j] 


WANoaPwnr 


oOo PF wh 
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7. exchange Ali + 1] o Alr] 
8. returni+1 
Example : Given array to be sorted 


3/1}4/1)/5)9)/2}6)/5)3)5/8)9 


Sort the array A using quick sort algorithm. 
Step 1: The array is Pivoted about it first element i.e., Pivot (P) = 





















































Step 2 : Find first element larger then pivot (make underline) and find 
element not larger than pivot from end make over line. 





Underline Overline 
Step 3: Swap these element and scan again. 





Underline Overline 
Apply Serene, 





Overline Underline 
The pointers have crossed 
i.e., overline on left of underlined 
Then, in this situation swap pivot with overline. 





Now, pivoting process is complete. 
Step 4: Recursively sort subarrays on each side of pivot. 


Subarray 1: |2]1)3/1 











Subarray 2:|/9/5/6/5/1)/5/8/9 
First apply Quick sort for subarray 1. 
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a1 |7)s) 
POA A 


Underline Overline 
The pointers have crossed. 
i.e., overline on left of underlined. 
Swap pivot with overline 





1)/1)2)3 
Sorted array 
Now, for subarray 2 we apply Quick sort procedure. 























Overline Underline 
The pointer has crossed. Then swap pivot with overline. 





Subarray 4 
Subarray 3 





Overline on left of underlined. 
Swap pivot with overline. 
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Analysis of complexity : 
Worst case : 


i. 


ii. 


1. 


ue 


Let T(n) be the worst case time for quick sort on input size n. We 
have a recurrence 


T(n) = max. (T(q) + Tin-—q—-1))+O(m)_ ...(1.19.1) 
o<qs<n— 


where g ranges from 0 to n — 1, since the partition produces two 
regions, each having size n — 1. 

Now we assume that T(n) < cn? for some constant c. 
Substituting our assumption in eq. (1.19.1) we get 


T(n) < a (eq? + c(n —q —1)*) + O(n) 
o<qsn- 


= max (q?+(n—q—1)?) + O(n) 


o<qs<n-1 

Since the second derivative of expression q? + (n — q — 1)? with 
respect to q is positive. Therefore, expression achieves a maximum 
over the range 0 <q <n-—1 at one of the endpoints. 
This gives the bound 
MAXg <g<n_1 (G+ (n-g- 1”) <(n-1)? =n?-2n+1 
Continuing with the bounding of T(n) we get 

T(n) < en? — c(2n — 1) + O(n) < en? 
Since we can pick the constant c large enough so that the c(2n — 1) 
term dominates the @(n) term. We have 

T(n) = O(n?) 
Thus, the worst case running time of quick sort is O(n”). 


Average case: 


1. 


If the split induced of RANDOMIZED_PARTITION puts constant 
fraction of elements on one side of the partition, then the 
recurrence tree has depth © (log n) and O(n) work is performed at 
each level. 
This is an intuitive argument why the average case running time 
of RANDOMIZED_QUICKSORT is O(n log n). 
Let T(n) denotes the average time required to sort an array of n 
elements. A call to RANDOMIZED_ QUICKSORT with a 1 element 
array takes a constant time, so we have 7(1) = 9 (1). 
After the split RANDOMIZED_QUICKSORT calls itself to sort 
two subarrays. 
The average time to sort an array A[1..q] is Tlq] and the average 
time to sort an array A[g+1 .. n] is T[n —q]. We have 
T(n) = 1/n (T(1) + Tn —- 1) + PSS Si T(q) 
T(n-q))) + O(n) ..(1.19.1) 
We know from worst-case analysis 
T(1) = © (1) and T(n — 1) = O(n?) 
T(n) = 1/n (@ (1) + O(n?) + In 210 5 (r(q) 
+ T(n —q)) + Q(n) 
=n TAS (T(q) + Tin —q)) + Q(n) _ ...(1.19.2) 
= Vn [2"-18,_,(T(k))] + O(n) 
= 2n”18,_, (T(k)) + O(n) ...(1.19.3) 
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6. Solve the above recurrence using substitution method. Assume 
that T(n) <an n logn + b for some constants a > 0 and b > 0. 
If we can pick ‘a’ and ‘0’ large enough so that n log n + b > T(1). Then for 
n> 1, we have 
T(n) =""10,_, 2/n (ak log k + b) + O(n) 
= 2a/n"18,_,k log k — 1/8(n?) + 2b/n 
(n-1)+On ...(1.19.4) 
At this point we are claiming that 
no, _,klogk< 1/2 n” log n— 1/8(n?) 
Substituting this claim in the eq. (1.19.4), we get 
T(n) < 2a/n [1/2n? log n — 1/8(n?)] + 2/n b(1 — 1) + O(n) 
< an logn—an/4 + 2b + O(n) ... (1.19.5) 
In the eq. (1.19.5), O(n) + 6 and an/4 are polynomials and we can choose ‘a’ 
large enough so that an/4 dominates O(n) + b. 
We conclude that QUICKSORT’s average running time is O(n log n). 


Que 1.20. | Discuss the best case and worst case complexities of 


quick sort algorithm in detail. 


Answer | 


Best case : 
1. The best thing that could happen in quick sort would be that each 
partitioning stage divides the array exactly in half. 
2. In other words, the best to be a median of the keys in Alp .. r] every 
time procedure ‘Partition’ is called. 
3. The procedure ‘Partition’ always split the array to be sorted into two 
equal sized arrays. 
4. Ifthe procedure ‘Partition’ produces two regions of size n/2, then the 
recurrence relation is : 
T(n) < T(n/2) + T(n/2) + O(n) < 2T(n/2) + O(n) 
And from case (2) of master theorem 
T(n) = O(n log n) 
Worst case : Refer Q. 1.19, Page 1-16B, Unit-1. 


PART-4 


Merge Sort. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 1.21. | Explain the concept of merge sort with example. 


AKTU 2016-17, Marks 10 
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Answer | 


1. Merge sort is asorting algorithm that uses the idea of divide and conquer. 

2. This algorithm divides the array into two halves, sorts them separately 
and then merges them. 

3. This procedure is recursive, with the base criteria that the number of 
elements in the array is not more than 1. 

Algorithm : 

MERGE_SORT (a, p, r) 

1. ifp<r 

2. theng<lLp+r)/2] 

3. MERGE-SORT (A, p, q) 

4. MERGE-SORT (A, q + 1,7r) 

5. MERGE (A, p, q,r) 





MERGE (A, p, q,r) 

1 n,=q-ptl 

2. Ny=r-q 

3. Create arrays L [1......... n, +1] and 
R[1......m9 + 1] 

4, fori=1ton, 
do 
Lili) =A [p+i-1 
endfor 

5. forj=1ton, 
do 
Rij] =Alg + Jl 
endfor 

6. L[n, + 1] =, Rin, + 11 = 00 

Ge. bedjei 

8. fork=ptor 
do 
if Lit) < RU 
then = A[k] < L[i] 

i=itl1 
else Alk] = Rij] 
jJ=j+1 

endif 
endfor 

9. exit 

Example: 


10, 25, 16, 5, 35, 48, 8 


1. Divide into two halves: | 10, 25, 16, 5 35, 48, 8 


2. Consider thefirst part:10, 25, 16, 5 again divide into two sub- 
arrays 
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10, 25 16, «5 


YO 





5, 10, 16, 25 


3. Consider the second half : 35, 48, 5 again divide into two sub-arrays 


35 , 48 8 
35, 48 8 


4. Merge these two sorted sub-arrays, 


5,10, 16, 25 





5, 8, 10, 16, 25, 35, 45 


This is the sorted array. 


Que 1.22. | Determine the best case time complexity of merge sort 


algorithm. 


Answer | 


The best case of merge sort occurs when the largest element of one 
array is smaller than any element in the other array. 
2. For this case only n/2 comparisons of array elements are made. 


3. Merge sort comparisons are obtained by the recurrence equation of 
the recursive calls used in merge sort. 
4. As it divides the array into half so the recurrence function is defined 


as: 
T(n) = r(2)+7(2) +n =or(”) +n (1.22.1) 


5. By using variable & to indicate depth of the recursion, we get 
n 
T(n) = aer(2) +kn ..(1,22.2) 
6. For the best case there are only n/2 comparisons hence equation (1.22.2) 
can be written as 


n n 


7. At the last level of recursion tree 
2H=n 
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k = log.n 
8. So the recurrence function is defined as : 


0} n n 
T(n) = Q0% eo -|+ +5 logan 


n n 
=nT(1) + 9 os. = 7g os. +n 


T(n) = O(n log, n) 
Hence, the best case complexity of merge sort is O( log, 7n). 


PART-5 


Heap Sort. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 1.23. | Explain heap sort algorithm with its complexity. 


OR 
Discuss Max-Heapify and Build-Max-Heap procedures. 


Answer | 


1. Heap sort is acomparison based sorting technique based on binary heap 
data structure. 

2. Heapsort finds the largest element and puts it at the end of array, then 
the second largest item is found and this process is repeated for all other 
elements. 

3. The general approach of heap sort is as follows : 

a. From the given array, build the initial max heap. 

b. Interchange the root (maximum) element with the last element. 

c. Use repetitive downward operation from root node to rebuild the 
heap of size one less than the starting. 

d. Repeat step a and b until there are no more elements. 

Analysis of heap sort: 

Complexity of heap sort for all cases is O(n log, 7). 

MAX-HEAPIFY (A, i): 

i< left [i] 

r < right [7] 

if ] < heap-size [A] and A[l] > Ali] 

then largest < / 

else largest <i 

if r < heap-size [A] and A[r] >A [largest] 

then largest <r 


a a 
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8. iflargest +i 

9. then exchange Ali] < Allargest] 

10. MAX-HEAPIFY JA, largest] 

HEAP-SORT(A): 

1. BUILD-MAX-HEAP (A) 

2. fori < length [A] down to 2 

3. do exchange A[1] < Alz] 

4 heap-size [A] < heap-size [A] — 1 

5. MAX-HEAPIFY (A, 1) 

BUILD-MAX-HEAP (A) 

1. heap-size (A) < length [A] 

2. fori < (length [A]/2) down to 1 do 

38. MAX-HEAPIFY (A, 7) 

We can build a heap from an unordered array in linear time. 

Average case and worst case complexity : 

1. We have seen that the running time of BUILD-HEAP is O(n). 

2. The heap sort algorithm makes a call to BUILD-HEAP for creating a 
(max) heap, which will take O(n) time and each of the (n — 1) calls to 
MAX-HEAPIFY to fix up the new heap (which is created after 
exchanging the root and by decreasing the heap size). 

3. We know ‘MAX-HEAPIFY’ takes time O(log 7). 

4. Thus the total running time for the heap sort is O(n log 7). 


Que 1.24. | How will you sort following array A of element using 
heap sort : A = (23,9, 18, 45, 5, 9, 1, 17, 6). 


AKTU 2018-19, Marks 10 
Answer | 


Given array : [23] 9 [18]45[ 5 [9 [1 [17] 6 | 
First we call Build-Max heap 
heap size [A] =9 





soi=4to 1 call MAX HEAPIFY (A, i) 
i.e., first we call MAX HEAPIFY (A, 4) 
All] = 7, Ali] = Al4] = 45, Alr] =6 
l<left [4)=2x4=8 
r<right[4]=2x4+1=9 
8 <9 and A[8] = 17 < 45 (False) 
Then, largest < 4. 
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Similarly for i = 3, 2, 1 we get the following heap tree : 





Now i = 9 down to 2 and size = 10 — 1 = 9 and call MAX HEAPIFY 
(A, 1) each time 
Exchanging A[1] © A[9] 





(ies ae eG 


Now call MAX HEAPIFY (A, 1) and 
Exchange A[1] and A[8], size =9-1=8 
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® O 
YB TF B 
JS OOD) GT OOO 


| | | {| {| | J 423] 45| 


Now, call MAX HEAPIFY (A, 1), exchange A[1] and A[4] and size = 5-1 


o 
|| | | 9 | 9 [a7] 18 | 28] 45 | 


Now, call MAX HEAPIFY (A, 1), exchange A[1] and A[3] and size = 4 — 


| of o% 


| | [69] 9 }i7{ is] 23] 45) 


Exchange A[1] and A[2] size 3-1=2 


a)--o-o 


| [5/6] 9] 9 ]17] 18] 23] 45] 


The sorted array 


ri [5 [6 [9 [o [ivpia [23] a5] 


Now call MAX HEAPIFY (A, 1) and exchange A[1] and A[7] 














Now call MAX HEAPIFY (A, 1) and size = 7- 1 = 6 exchange A[1] and 
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Exchange A[1] and A[5] and size =6-—1=5 
(9) () 
— 
ae) CO 
© & ©O & 


Que 1.25. | What is heap sort ? Apply heap sort algorithm for 
sorting 1, 2, 3, 4, 5, 6, 7, 8,9, 10. Also deduce time complexity of heap 


sort. AKTU 2015-16, Marks 10 
Answer | 


Heap sort and its time complexity : Refer Q. 1.23, Page 1-23B, Unit-1. 
Numerical : Since the given problem is already in sorted form. So, there is 
no need to apply any procedure on given problem. 


Que 1.26. | Explain HEAP SORT on the array. Illustrate the 
operation HEAP SORT on the array A = {6, 14, 3, 25, 2, 10, 20, 7, 6} 


AKTU 2017-18, Marks 10 
Answer | 


Heap sort: Refer Q. 1.23, Page 1-23B, Unit-1. 
Numerical : 

Originally the given array is : [6, 14, 3, 25, 2, 10, 20, 7, 6] 
First we call BUILD-MAX-HEAP 

heap size [A] = 9 


©) 
aay (3) 


@ O@ @ 
OQ © 


so, i= 4 to 1, call MAX-HEAPIFY (A, 7) 
i.e., first we call MAX-HEAPIFY (A, 4) 
Az [I] = 7, A [i] =A [4] = 25, A [7] =6 
Z< left [4] = 8 
r< right [4] = 9 
8 <9 and 7 > 25 (False) 
Then, largest < 4 
9<9 and 6 > 25 (False) 
Then, largest = 4 
A [li] oA [4] 
Now call MAX-HEAPIFY (A, 2) 
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Gi) 





(vi) (vii) 


(viii) 
Now i = 9 down to 2, and size = size — 1 and call MAX-HEAPIFY 


(A, 1) each time. 
exchanging A [1] + A [9] 
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Now call MAX-HEAPIFY (A, 1) we get 
Now exchange A [1] and A [8] and size = 8-1=7 


| 





6 | 14] 10| 7] 2/6 | 3:20 
Again call MAX-HEAPIFY (A, 1), we get 
exchange A [1] and A [7] and size = 7-1=6 


fs [7 [w[s [2 fo tu) 
Again call MAX-HEAPIFY (A, 1), we get 
exchange A [1] and A [6] and now size = 6-1=5 





Again call MAX-HEAPIFY (A, 1) 
exchange A [1] and A [5] and now size =5-1=4 
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Again, call MAX-HEAPIFY (A, 1) 
exchange A [1] and A [4] and size=4-1=3 


oo + 7» 


call MAX-HEAPIFY (A, 1) 


exchange A [1] and A [3], size=3-1=2 


~~ 


call MAX-HEAPIFY (A, 1) 
exchange A [1] and A [2] and size=2-1=1 


_. _& 
o> — @ 


Thus, sorted array : 
en 
PART-6 


Comparison of Sorting Algorithms, Sorting in Linear Time. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 1.27. | How will you compare various sorting algorithms ? 
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Answer | 
































Name Average Worst Stable Method Other notes 
case case 

Selection O(n?) O(n?) No Selection Can be 

sort implemented as 
a stable sort 

Insertion O(n?) O(n?) Yes Insertion Average case is 

sort also O(n + d), 
where d is the 
number of 
inversion 

Shell - O(n log? n)} ~No Insertion No extra 

sort memory required 

Merge O(n log n) O(n log n) Yes Merging Recursive, extra 

sort memory required 

Heap O(n log n) O(n log n) No Selection Recursive, extra 

sort memory required 

Quick O(n log n) O(n?) No Partitioning | Recursive, based 

sort on divide conquer 
technique 














Que 1.28. | Explain the counting sort algorithm. 


Answer | 


Counting sort is a linear time sorting algorithm used to sort items when they 
belong to a fixed and finite set. 

Algorithm : 

Counting _Sort(A, B, k) 


let C[0..k] be a new array 
2. fori<Otok 
3. doCli]<0 
4. forj <1 to lengthI[A] 
5. do C[AUj]] <— CIA] +1 
// C[i] now contains the number of elements equal to 7. 
6. fori<1tok 
7. doCli] <— Cli] + Clii-1 
// C[i] now contains the number of elements less than or equal to 7. 
8. for j< length[A] down to 1 
9. do BIC{A[]]] — AU 
10. C[AU]] <— CIA] -1 


re 
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Que 1.29. | What is the time complexity of counting sort ? Illustrate 
the operation of counting sort on array A = {1, 6, 3, 3, 4, 5, 6, 3, 4, 5}. 


Answer | 


Given array : Time complexity of counting sort is O(n). 
12345678910 


A|1]6]/3]3/4]5]6]3[4] 5) 


Step 1: i=0to6 k =6 (largest element in array A) 
Cli]< 0 
0123456 
CLofo] ofofofojo| 
Step2: j=1to10 (-. length [A] = 10) 


CIAU]] < CIAU]] +1 
Forj=1 
0123456 


CIA[I] < Cll] +1=0+1=1 cl[o]ifofofofo]o| 
C{i] <1 
Forj=2 

01234456 


CIA[2I] <— Cl6] +1=0+1=1 c[ofi]ofofojo]i 
C[6] << 1 
01234056 


Similarly for j =5, 6, 7,8,9,10 c[o]1]o[3]2[2]2] 
Step3: 
Fori=1to6 
Cli] —Cli] + Ci - 1 
Fori=1 
0123456 


Cll] — Cll +clo] cc [o [1 [0] 3] 2] 2[2] 
Clll<1+0=1 
Fori=2 

0123456 


Clal< ca+ctu c[o]if1]3][2]2]21 
Clile1+0=1 
0123456 


Similarly for i = 4, 5,6 C [0 [1] 1[4] 6] 8] 10] 
Step 4: 

Forj =10to1 

BICIAUI] —A UI 

CIAU 1] << CIA] -1 
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J | AU] |CIAGN | BICIAGII<AQl | CIAQI<CIAUN-1 
10 5 8 B[8]) <5 C[5] <—7 
9 4 6 Bl6]<4 C[4] <— 5 
8 3 4 Bl[4]< 3 C[3] < 3 
7 6 10 B [10] <6 Cl6é] <— 9 
6 5 7 B(N<5 C[5] — 6 
5 4 5 Bis] <4 cl4] << 4 
4 3 3 B[3]< 3 C[3] < 2 
3 3 2 B[2]< 3 C[3] << 1 
2 6 9 Big] <6 C[6] < 8 
1 1 1 Bllij<c1 C1] <0 




















12345678910 


B{1/3]3]3]4] 4[5]5/6 | 6] 


Que 1.30. | Write the bucket sort algorithm. 
Answer | 

1. The bucket sort is used to divide the interval [0, 1] into n equal-sized 
sub-intervals, or bucket, and then distribute the n-input numbers into 
the bucket. 

2. Since the inputs are uniformly distributed over [0, 1], we do not except 
many numbers to fall into each bucket. 

3. Toproduce the output, simply sort the numbers in each bucket and then 
go through the bucket in order, listing the elements in each. 

4. Thecode assumes that input is in n-element array A and each element 


inA satisfies 0 < Ali] < 1. We also need an auxiliary array B[0 ...n—1] for 
linked-list (buckets). 


BUCKET_SORT (A) 


Ook Ww NE 


n < length [A] 

fori<lton 

do Insert Ali] into list B[|nAli]]] 

fori< Oton-1 

do Sort list B[i] with insertion sort 

Concatenate the lists B[0], B[1], .... B[n — 1] together in order. 


Que 1.31. | What do you mean by stable sort algorithms ? Explain it 


with suitable example. 
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Answer | 





1. A sorting algorithm is said to be stable if two objects with equal keys 
appear in the same order in sorted output as they appear in the input 
sorted array. 

2. Astable sort is one where the initial order of equal items is preserved. 

3. Some sorting algorithms are stable by nature, such as bubble sort, 
insertion sort, merge sort, counting sort etc. 

4. LetAbean array, and let < be a strict weak ordering on the elements of 
A. Sorting algorithm is stable if : 
i<jand Ali] =Alj] i.e., Ali] comes before A[j]. 

5. Stability means that equivalent elements retain their relative positions, 


after sorting. 
For example : 


Sorting is stable because the 

order of balls is maintained when 
values are same. The bal with gray 
color and value 10 appears before the 
white color ball with value 10. 
Similarly order is maintained for 20. 


Que 1.32. | Write a short note on radix sort. 


Answer 


1. Radix sort is a sorting algorithm which consists of list of integers or 
words and each has d-digit. 

2. Wecanstart sorting on the least significant digit or on the most significant 
digit. 

3. On the first pass entire numbers sort on the least significant digit (or 
most significant digit) and combine in a array. 

4. Then on the second pass, the entire numbers are sorted again on the 
second least significant digits and combine in an array and so on. 

RADIX_SORT (A, d) 

1. fori<1toddo 

2.  useastable sort to sort array A on digit i 
// counting sort will do the job 
The code for radix sort assumes that each element in the n-element 
array A has d-digits, where digit 1 is the lowest-order digit and d is the 
highest-order digit. 

Analysis : 

1. The running time depends on the table used as an intermediate sorting 
algorithm. 
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2. When each digit is in the range 1 to k, and k is not too large, 
COUNTING_SORT is the obvious choice. 

3. In case of counting sort, each pass over n d-digit numbers takes 
O(n +k) time. 

4. There ared passes, so the total time for radix sort is 0(n + k) time. There 
are d passes, so the total time for radix sort is (dn + kd). When d is 
constant and k = @(n), the radix sort runs in linear time. 

For example : This example shows how radix sort operates on seven 3- 





digit number. 
Table 1.32.1. 
Input 1t pass 2™4 pass 3rd pass 
329 720 720 329 
457 355 329 355 
657 436 436 436 
839 457 839 457 
436 657 355 657 
720 329 457 720 
355 839 657 839 

















In the table 1.32.1, the first column is the input and the remaining 
shows the list after successive sorts on increasingly significant digits 
position. 


Que 1.33. | Among Merge sort, Insertion sort and quick sort which 


sorting technique is the best in worst case. Apply the best one among 
these algorithms to sort the list E, X, A, M, P, L, E in alphabetic order. 


AKTU 2019-20, Marks 07 
Answer | 


Merge sort technique is best in worst case because of its time complexity 
O(n log n). 

Numerical : 

Given : E, X, A, M, P, L, E 

Pass 1: Merge each pair of element to obtain sorted list : 


[P [LE] 


After sorting each pair, we get 


[L | P| 


Pass 2: Merge each pair to obtain the list : 


[E| 1] P| 


Pass 3 : Again merge the two sub arrays to obtain the list : 


[A | E/E [Li [MP] x) 
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VERY IMPORTANT QUESTIONS 


Following questions are very important. These questions 
may be asked in your SESSIONALS as well as 


UNIVERSITY EXAMINATION. 











Q. 1. 
Ans. 


Q. 2. 
Ans. 


Q.3.i. 


ii. 
Ans. 


Q. 4. 
Ans. 


Q. 5. 
Ans. 


Q. 6. 
Ans. 


Q. 7. 
Ans. 


Q. 8. 


Ans. 


What do you mean by algorithm ? Write its characteristics. 
Refer Q. 1.1. 


Write short note on asymptotic notations. 
Refer Q. 1.3. 


Solve the recurrence T (n) = 2T(n/2) + n?2+2n+1 

Prove that worst case running time of any comparison sort 
is Q (n log n). 

Refer Q. 1.9. 


Explain shell sort with example. 
Refer Q. 1.16. 


Discuss quick sort method and analyze its complexity. 
Refer Q. 1.19. 


Explain the concept of merge sort with example. 
Refer Q. 1.21. 


Write short note on heap sort algorithm with its analysis. 
Refer Q. 1.23. 


Explain HEAP SORT on the array. Illustrate the operation 


HEAP SORT on the array A = {6, 14, 3, 25, 2, 10, 20, 7, 6} 
Refer Q. 1.26. 


OOO 
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UNIT 
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fi CONTENTS 7 
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PART-1 


Red-Black Trees. 











Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 2.1. | Define a red-black tree with its properties. Explain 


the insertion operation in a red-black tree. 


Answer | 


Red-black tree: 
A red-black tree is a binary tree where each node has colour as an extra 
attribute, either red or black. It is a self-balancing Binary Search Tree (BST) 
where every node follows following properties : 
Every node is either red or black. 
The root is black. 
Every leaf (NIL) is black. 
If a node is red, then both its children are black. 
For each node, all paths from the node to descendent leave contain the 
same number of black nodes. 
Insertion : 
i. We begin by adding the node as we do in a simple binary search tree 
and colouring it red. 
RB-INSERT(T, z) 
1 y<nil [7] 
. x <€ root [T] 


oP ON Pr 


2 
8. whilex #nil [T] 

4, doy<x 

5. if key[z] < key [x] 

6 then x < left [x] 

7 else x < right [x] 

8. plzel<y 

9. ify=nil [7] 

10. then root [T] < z 

11. else if key [z] < keyly] 
12. then left [y]< z 

13. else right [y] < z 

14. left [z] < nil[T] 

15. right [z] < nil[T] 

16. colour [z] < RED 

17. RB-INSERT-FIXUP(T, z) 
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ii. Now, for any colour violation, RB-INSERT-FIXUP procedure is used. 
RB-INSERT-FIXUP(T, z) 


1. while colour [p[z]] = RED 

2. do if p[z] = left[p [p [z]]] 

3. then y < right[p [p [z]]] 

4, if colour[y] = RED 

5. then colour[p [z]] < BLACK => case 1 
6. colourly] < BLACK => case 1 
7. colour|p [p [z]]]}<- RED => case 1 
8. z<p [plall => case 1 
9. else if z = right [plz]] 

10. then z < plz] => case 2 
11. LEFT-ROTATE(T, z) => case 2 
12. colour [p[z]] <- BLACK => case 3 
13. colour|p[p[z]]] < RED => case 3 
14. RIGHT-ROTATE(T, p[plz]]) => case 8 
15. else (same as then clause with “right” and “left” exchanged) 


16. colour[root[T]] <- BLACK 
Cases of RB-tree for insertion : 
Case 1: 2’s uncle is red : 
Plz] = left[p[plzl]] 
then uncle < right[p[p[z]]] 
a. change z’s grandparent to red. 
b. change 2’s uncle and parent to black. 
c. change z to z’s grandparent. 


Case 1 
——_> 





Fig. 2.1.1. 


Now, in this case violation of property 4 occurs, because z’s uncle y is red, 
then case 1is applied. 

Case 2: 2’s uncle is black, z is the right of its parent : 

a. Change z to 2’s parent. 

b. Rotate z’s parent left to make case 3. 
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(a) Fig. 2.1.2. 


Case 8: 2’s uncle is black, z is the left child of its parent : 
a. Setz’s parent black. 

b. Set z’s grandparent to red. 

c. Rotate z’s grandparent right. 





Fig. 2.1.3. (b) 





Que 2.2. | What are the advantages of red-black tree over binary 


search tree ? Write algorithms to insert a key in a red-black tree 
insert the following sequence of information in an empty red-black 
tree 1, 2, 3, 4, 5, 5. 


Answer | 


Advantages of RB-tree over binary search tree : 

1. The main advantage of red-black trees over AVL trees is that a single 
top-down pass may be used in both insertion and deletion operations. 

2. Red-black trees are self-balancing while on the other hand, simple binary 
search trees are unbalanced. 

3. Itis particularly useful when inserts and/or deletes are relatively frequent. 

4. Time complexity of red-black tree is O(log n) while on the other hand, a 
simple BST has time complexity of O(n). 

Algorithm to insert a key in a red-black tree : Refer Q. 2.1, Page 2-2B, 

Unit-2. 
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Numerical : 
Insert 1: @? 

B 
Insert 2: 

R 

B 
Insert 3: B 
Insert 4: 
Insert 5: 
Insert 5: 





Fig. 2.2.1. 


Que 2.3. | Explain red-black tree. Show steps of inserting the keys 
41, 38, 31, 12, 19, 8 into initially empty red-black tree. 
OR 
What is red-black tree ? Write an algorithm to insert a node in an 
empty red-black tree explain with suitable example. 


AKTU 2017-18, Marks 10 
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Answer | 


Red-black tree and insertion algorithm : Refer Q. 2.1, Page 2-2B, Unit-2. 








Numerical : 
B 
Insert 41 : 4) 
B 
Insert 38 : te 
G8) 
Insert 31: 
Case 3 R R 
—_> 
Gi) = @) 
Insert 12: 
B 
Case 1 R (38) R 
~~ ee 
@2) 
Insert 19: 
B 
Case 2,3 B (38) B 
_ & @ 
R 
@) &) 





Insert 8: 
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Que 2.4. | Explain insertion in red-black tree. Show steps for 
inserting 1, 2, 3, 4, 5, 6, 7,8 and 9 into empty RB-tree. 


AKTU 2015-16, Marks 10 
Answer | 


Insertion in red-black tree : Refer Q. 2.1, Page 2-2B, Unit-2. 


B 
Insert 1: @) 
B 


Insert 2: Ve 





Insert 3: 
B B 
wiaadceno 
xoON R R R 
Insert 4: 
a 
Insert 5: 


Insert 6: 
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Insert 7: 





Insert 8: 





Insert 9: 





Que 2.5. | How to remove a node from RB-tree ? Discuss all cases 


and write down the algorithm. 


Answer | 


To remove a node from RB-tree RB-DELETE procedure is used. In 
RB-DELETE procedure, after splitting out a node, it calls an auxiliary 
procedure RB-DELETE-FIXUP that changes colours and performs rotations 
to restore the red-black properties. 
RB-DELETE(T, z) 
if left[z] = nil[T] or right[z] = nil[T] 

then y < z 

else y < TREE-SUCCESSOR(z) 
if left[y] + nil[T] 

then x < left[y] 

else x < rightly] 
pix] <— ply] 
if ply] = nil[T] 


a 


SAGAR WD 
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9. then root[T] < x 

10. else if y = left[ply]] 

11. then left[p[y]] <x 

12. else right[plyl] <x 

13. ify #z 

14. then keylz] < keyly] 

15. copy y’s sibling data intoz 


16. if colourly] = BLACK 

17. then RB-DELETE-FIXUP(T, x) 

18. return y 

RB-DELETE-FIXUP(T, x) 

1. while x #root[T] and colour[x] = BLACK 


2 do if x = left[p[x]] 

3 then w < right[p[x]] 

4. if colour[w] = RED 

5. then colour[w] < BLACK => case 1 
6 colour[p[x]] <_ RED => case 1 
7 LEFT-ROTATE(T7, p[x]) => case 1 
8. w < right|pIx]] => case 1 
9. if colour[left[w]] = BLACK and colour[right[w]] = BLACK 

10. then colour[w] < RED => case 2 
11. x < pix] => case 2 
12. else if colour[right[w]] = BLACK 

13. then colour[left[w]] <- BLACK => case 3 
14. colour[w] <- RED => case 3 
15. RIGHT-ROTATE(T, w) => case 3 
16. w < right|pIx]] => case 3 
17. colour[w] < colour[p[x]] => case 4 
18. colour[p[x]] <- BLACK => case 4 
19. colour[right[w]] <- BLACK => case 4 
20. LEFT-ROTATE(T, p[x]) => case 4 
21. x < root[T] => case 4 
22. else (same as then clause with “right” and “left” exchanged). 


23. colour[x] < BLACK 
Cases of RB-tree for deletion : 
Case 1: x’s sibling w is red : 

1. It occurs when node w the sibling of node x, is red. 

2. Since w must have black children, we can switch the colours of w 
and p[x] and then perform a left-rotation on p[x] without violating 
any of the red-black properties. 

3. The new sibling of x, which is one of w’s children prior to the 
rotation, is now black, thus we have converted case 1 into case 2, 3 
or 4. 

4. Case 2, 3 and 4 occur when node w is black. They are distinguished 
by colours of w’s children. 














Advanced Data Structure 2-10 B (CS/IT-Sem-5) 








Fig. 2.5.1. 


Case 2: x’s sibling w is black, and both of w’s children are black: 

1. Both of w’s children are black. Since w is also black, we take one 
black of both x and w, leaving x with only one black and leaving w 
red. 

2. For removing one black from x and w, we add an extra black to 
pix], which was originally either red or black. 

3. We do so by repeating the while loop with p[x] as the new node x. 

4. If we enter in case 2 through case 1, the new node x is red and 
black, the original p[x] was red. 

5. The value c of the colour attribute of the new node x is red, and 
the loop terminates when it tests the loop condition. The new 
node x is then coloured black. 





Fig. 2.5.2. 


Case 3: x’s sibling w is black, w’s left child is red, and w’s right child 
is black: 

1. Case 3 occurs when w is black, its left child is red and its right child 
is black. 

2. Wecan switch the colours of w and its left child left[w] and then 
perform a right rotation on w without violating any of the red- 
black properties, the new sibling w of x is a black node with a red 
right child and thus we have transformed case 3 into case 4. 
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(a) Fig. 2.5.3. (6) 3 


Case 4: x’s sibling w is black, and w’s right child is red: 
1. When node x’s sibling w is black and w’s right child is red. 
2. By making some colour changes and performing a left rotation on 
pix], we can remove the extra black on x, making it singly black, 
without violating any of the red-black properties. 





Fig. 2.5.4. (b) 


Que 2.6. | Insert the nodes 15, 13, 12, 16, 19, 23, 5, 8 in empty 


red-black tree and delete in the reverse order of insertion. 


AKTU 2016-17, Marks 10 
Answer | 


Insertion : 


B 
Insert 15: (5) 


R £3)" 
Insert 13: 


Insert 12: 
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Insert 16: 
Insert 19: 
B 
B (13) B 
ay 0) 
Insert 23: 





Insert 5: 





Insert 8: 
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Deletions : 
Delete8: 





Delete 12: 


Delete 13: 
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Delete 15: 
No tree 


Que 2.7. | Insert the following element in an initially empty 


RB-Tree. 
12, 9, 81, 76, 23, 43, 65, 88, 76, 32, 54. Now delete 23 and 81. 


AKTU 2019-20, Marks 07 
Answer | 


Insert 12: 







Insert 9: 


Insert 81: 


Insert 76: 


Insert 23: 
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Insert 32: B 
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Delete 23: 






Que 2.8. | Describe the properties of red-black tree. Show the 


red-black tree with n internal nodes has height at most 2 log (n + 1). 
OR 

Prove the height h of a red-black tree with n internal nodes is not 

greater than 2 log (n + 1). 


Answer | 


Properties of red-black tree : Refer Q. 2.1, Page 2-2B, Unit-2. 
1. By property 5 of RB-tree, every root-to-leaf path in the tree has the 

same number of black nodes, let this number be B. 
2. Sothere are no leaves in this tree at depth less than B, which means the 
tree has at least as many internal nodes as a complete binary tree of 
height B. 
Therefore, n < 28 — 1. This implies B < log (n + 1). 
By property 4 of RB-tree, at most every other node on a root-to-leaf 
path is red, therefore, h < 2B. 
Putting these together, we have 

h< 2 log (n+ 1). 


m oo 
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Que 2.9. | Insert the elements 8, 20, 11, 14, 9, 4, 12 in a Red-Black 


tree and delete 12, 4, 9, 14 respectively. 
AKTU 2018-19, Marks 10 
Answer | 


Insert 8: 


Insert 20: 


Insert 11 : Since, parent of node 11 is red. Check the colour of uncle of 
node 11. Since uncle of node 11 is nil than do rotation and recolouring. 


ey @) Left B 
a) rotation (11) 
—_ DR —_ ® a) 
R 
@) SR 


Insert 14: Uncle of node 14 is red. Recolour the parent of node 14 .e., 
20 and uncle of node 14 i.e., 8. No rotation is required. 


B B 
(1) (1) 
B R —_> B 
8) {29 ) 29 
RY Ra 
Insert 9: Parent of node 9 is black. So no rotation and no recolouring. 
B 


B 
(11) (11) 
B Bo— > B B 
(8) @d) (8) G0 
R R 
RQ) & RG) & 


Insert 4: Parent of node 4 is black. So no rotation and no recolouring. 
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Insert 12 : Parent of node 12 is red. Check the colour of uncle of node 
12, which is nil. So do rotation and recolouring. 





Delete 14: Node 14 is internal node replace node 14 with node 20 and do 
not change the colour. 





PART-2 


B-Trees. 
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Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 2.10. | Define a B-tree of order m. Explain the searching and 


insertion algorithm in a B-tree. 


Answer | 


A B-tree of order m is an m-ary search tree with the following properties : 
1. The root is either leaf or has atleast two children. 
2. Each node, except for the root and the leaves, has between m/2 and m 
children. 
3. Each path from the root to a leaf has the same length. 
4. The root, each internal node and each leaf is typically a disk block. 
5. Each internal node has upto (m — 1) key values and upto m children. 
SEARCH (x, k) 
i<1 
while i < n[x] and k > key, [x] 
doi<it+l 
if i < n[x] and k = key, |x] 
then return(x, i) 
if leaf[x] 
then return NIL 
else DISK-READ(¢,[x]) 
return B-TREE-SEARCH (c,[x], k) 
-TREE-INSERT(, k) 
r<root(T] 
if n[r] = 2¢ — 
then s <— Tope enue () 
root[T] << S 
leaf[s] <- FALSE 
n[s] <— 0 
e,ls] <r 
B-TREE SPLIT CHILD(S, J, r) 
B-TREE-INSERT-NONFULL(s, 2) 
10. else B-TREE-INSERT-NONFULL(;, 2) 
B-TREE SPLIT CHILD(x, i, y) 
1. z< ALLOCATE-NODE ( ) 
2. leaf[z] < leafly] 
3. nize]<t-1 


WONAAPRP HNP WOMAN oarwn re 
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4. forj<1tot-1 

5. dokey,[z] < key,,,[y] 

6. if not leafly] 

7. then forj<1tot 

8. do cz] © Cus ly] 

9. niy])<t-1 

10. forj < n[x] + 1 down toi+1 
11. do ¢,,,[] <—¢, [x] 

12. ¢,,,[«] <z 

13. for j < n[x] down toi 

14. do key,, [x] <— key, [x] 

15. key,[x] < key,ly] 

16. nix] < n[x] +1 

17. DISK-WRITEIy] 

18. DISK-WRITE[z] 

19. DISK-WRITE[x] 

The CPU time used by B-TREE SPLIT CHILD is 6(¢). The procedure performs 
0(1) disk operations. 
B-TREE-INSERT-NONFULL(, k) 
L< n{x] 

if leaf[x] 

then while i > 1 and k < key, [x] 
do key, 


i+1 


[x] <— key, [x] 
i<ci-1 

Ix] <k 

n[x] <— n[x] +1 
DISK-WRITE(x) 

else while i > 1 andk < key, [x] 
doi<ei-1 


key. 


i+1 


OS OrNIanarwnr 


a 
ie 


. Leit+l 

12. DISK-READ¢ [x]) 

13. if nlc, [x] = 2t-—1 

14. then B-TREE-SPLIT-CHILD(, i, ¢,[x]) 
15. ifk > key, |x] 

16. theni<i+1 

17. B-TREE INSERT NONFULL(, [x], 2) 
The total CPU time use is O(th) = O(¢ log, n) 


Que 2.11. | What are the characteristics of B-tree ? Write down the 


steps for insertion operation in B-tree. 
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Answer | 


Characteristic of B-tree : 

1. Each node of the tree, except the root node and leaves has at least m/2 
subtrees and no more than m subtrees. 

2. Root of tree has at least two subtree unless it is a leaf node. 

3.  Allleaves of the tree are at same level. 

Insertion operation in B-tree : 

In a B-tree, the new element must be added only at leaf node. The insertion 

operation is performed as follows : 

Step 1: Check whether tree is empty. 

Step 2: If tree is empty, then create a new node with new key value and 

insert into the tree as a root node. 

Step 3: If tree is not empty, then find a leaf node to which the new key value 

can be added using binary search tree logic. 

Step 4: Ifthat leaf node has an empty position, then add the new key value 

to that leaf node by maintaining ascending order of key value within the 

node. 

Step 5: If that leaf node is already full, then split that leaf node by sending 

middle value to its parent node. Repeat the same until sending value is fixed 

into a node. 

Step 6: If the splitting is occurring to the root node, then the middle value 

becomes new root node for the tree and the height of the tree is increased by 





one 
Que 2.12. | Describe a method to delete an item from B-tree. 


Answer | 


There are three possible cases for deletion in B-tree as follows : 

Let k be the key to be deleted, x be the node containing the key. 

Case 1: If the key is already in a leaf node, and removing it does not cause 

that leaf node to have too few keys, then simply remove the key to be 

deleted. Key & is in node x and x is a leaf, simply delete k from x. 

Case 2: If key & is in node x and x is an internal node, there are three cases 

to consider : 

a. Ifthe child y that precedes k in node x has at least t keys (more than the 
minimum), then find the predecessor key k' in the subtree rooted at y. 
Recursively delete k' and replace k with k' in x. 

b. Symmetrically, ifthe child z that follows 2 in node x has at least t keys, 
find the successor k' and delete and replace as before. 

c. Otherwise, if both y and z have only ¢ — 1 (minimum number) keys, 
merge & and all of z into y, so that both & and the pointer to z are 
removed from x, y now contains 2t — 1 keys, and subsequently k is 
deleted. 

Case 3: If key 2 is not present in an internal node x, determine the root of 

the appropriate subtree that must contain &. If the root has only ¢ — 1 keys, 
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execute either of the following two cases to ensure that we descend to a node 
containing at least t keys. Finally, recurse to the appropriate child of x. 

a. Ifthe root has only ¢ — 1 keys but has a sibling with t keys, give the root 
an extra key by moving a key from x to the root, moving a key from the 
roots immediate left or right sibling up into x, and moving the appropriate 
child from the sibling to x. 

If the root and all of its siblings have ¢t — 1 keys, merge the root with one 
sibling. This involves moving a key down from x into the new merged 
node to become the median key for that node. 


a 


Que 2.13. | How B-tree differs with other tree structures ? 


Que 2:13. | 


1. In B-tree, the maximum number of child nodes a non-terminal node 
can have is m where m is the order of the B-tree. On the other hand, 
other tree can have at most two subtrees or child nodes. 


2. B-tree is used when data is stored in disk whereas other tree is used 
when data is stored in fast memory like RAM. 

3. B-tree is employed in code indexing data structure in DBMS, while, 
other tree is employed in code optimization, Huffman coding, etc. 

4. The maximum height ofa B-tree is log mn (m is the order of tree and 
nis the number of nodes) and maximum height of other tree is log, n 
(base is 2 because it is for binary). 

5. A binary tree is allowed to have zero nodes whereas any other tree 


must have atleast one node. Thus binary tree is really a different kind 
of object than any other tree. 


Que 2.14. | Insert the following key in a 2-3-4 B-tree : 
40, 35, 22, 90, 12, 45, 58, 78, 67, 60 and then delete key 35 and 22 one after 


other. AKTU 2018-19, Marks 07 
Answer | 


In 2-3-4 B-trees, non-leaf node can have minimum 2 keys and maximum 4 
keys so the order of tree is 5. 
Insert 40, 35, 22, 90: 


Insert 12: 





Insert 45, 58: 
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Insert 78: 





Insert 67, 60: 





Delete 35: 





Delete 22: 





Que 2.15. | Explain B-tree and insert elements B, Q, L, F into 


B-tree Fig. 2.15.1 then apply deletion of elements F, M, G, D, B on 
resulting B-tree. 





AKTU 2015-16, Marks 10 
Answer | 


B-tree : Refer Q. 2.10, Page 2—-20B, Unit-2. 
Numerical : 
Insertion : 
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Insert F: 





Deletion: 
Delete F: 
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Que 2.16. | Insert the following information, F, S, Q, K, C, L, H, T, V, 
W, M, R, N, P, A, B,X, Y, D, Z, E, G, [into an empty B-tree with degree 


t=3. AKTU 2017-18, Marks 10 


Answer | 
Assume that t=3 
2t-1=2x3-1=6-1=5 
and t-1=3-1=2 


So, maximum of 5 keys and minimum of 2 keys can be inserted in a node. 
Now, apply insertion process as : 










































































Insert F: F 
Insert S: F\S 
Insert Q: F/Q\S 
Insert K: F\/K/Q|S 
Insert C: C/F|K/Q/S 
Insert L : C\F\|K/L/Q/S 
As, there are more than 5 keys in this node. 
Find median, n|x] = 6 (even) 
Median = fel = b 22 
2 2 


Now, median = 3, 
So, we split the node by 3" key. 


_—- 
Median 


(splitting point) 
Move up 





Insert H, T: 





Insert V: 
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Insert W: 
[L[@]s[r[v]w 
More than 5 keys split node from Median. 
n|x] = 6 [even] 
: nix] 6 : 
Median = ere 3 (i.e., 3° key move up) 
BD 
Insert M,R,N: 
LM IN [QR 
Insert P: 
PMNEOR 
More than 5 key 
split the node 
n[x] = 6 
: n[x] 6 ‘ 
Median = age 3 (i.e., 3° key move up) 
Insert A, B: 





ABICRH 
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Insert X, Y: 
[BIC 

Insert D: 

[A[B)cp[F EH 

More than 5 key 

split the node 

n|x] = 6 (even) 
Median = a = - =3 (i.e., 3° key move up) 

Insert Z, E: 








More than 5 key 
split the node 
n[x] =6 
nix] 6 


Median = “gos 3 (i.e., 3° key move up) 





Insert G,I: 
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(AL?) [DIE] | Pal 


Fig. 2.16.1. Inserted all given information with degree t = 3. 


Que 2.17. | Using minimum degree ’ as 3, insert following sequence 


of integers 10, 25, 20, 35, 30, 55, 40, 45, 50, 55, 60, 75, 70, 65, 80, 85 and 90 
in an initially empty B-Tree. Give the number of nodes splitting 


operations that take place. AKTU 2019-20, Marks 07 
Answer | 


Insert 10, 25, 20, 35: 


PEN EE es 


Insert 30: 















2580] 





Insert 55: 
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Insert 50, 55: 


rao] 3020 50) 









Insert 60, 75: 


Split 
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Insert 70, 65: 











Split 


> 
feo] 65 [70] 76) 


40 | 50 | 55 


Split 
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Number of nodes splitting operations = 9. 


PART-3 


Binomial Heaps. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 





Que 2.18. | Explain binomial heap and properties of binomial tree. 


Answer | 


Binomial heap : 

1. Binomial heap is a type of data structure which keeps data sorted and 
allows insertion and deletion in amortized time. 

2. Abinomial heap is implemented as a collection of binomial tree. 

Properties of binomial tree : 

1. The total number of nodes at order & are 2". 

2. The height of the tree is k. 


k 
3. There are exactly (*) i.e., *C, nodes at depthi fori =0, 1, ...., k (this is 


why the tree is called a “binomial” tree). 
4. Root has degree k (children) and its children are B 
left to right. 


Que 2.19. | What is a binomial heap ? Describe the union of 


binomial heap. 


pa Byos +++) By from 


OR 
Explain the different conditions of getting union of two existing 
binomial heaps. Also write algorithm for union of two binomial 


heaps. What is its complexity ? AKTU 2018-19, Marks 10 
Answer | 


Binomial heap: Refer Q. 2.18, Page 2-33B, Unit-2. 

Union of binomial heap : 

1. The BINOMIAL-HEAP-UNION procedure repeatedly links binomial 
trees where roots have the same degree. 

2. The following procedure links the B,, tree rooted at node to the 
B,,, tree rooted at node z, that is, it makes z the parent of y. Node z thus 
becomes the root of a B, tree. 
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BINOMIAL-LINK (y, z) 

i pll<z 

ii. sibling [y] < child[z] 

iii. child[z] < y 

iv. degree[z] < degreelz] + 1 

3. The BINOMIAL-HEAP-UNION procedure has two phases : 

a. The first phase, performed by the call of BINOMIAL-HEAP- 
MERGE, merges the root lists of binomial heaps H, and H, into a 
single linked list H that is sorted by degree into monotonically 
increasing order. 

b. The second phase links root of equal degree until at most one root 
remains of each degree. Because the linked list H is sorted by 
degree, we can perform all the like operations quickly. 

BINOMIAL-HEAP-UNION(H,, H,) 
H <« MAKE-BINOMIAL-HEAP ( ) 
head[H] <— BINOMIAL-HEAP-MERGE(H,, H,) 
Free the objects H, and H, but not the lists they point to 
if head[H] = NIL 
then return H 
prev-x« < NIL 
x < head[H] 
next-x < sibling[x] 
while next-x + NIL 
0. do if (degree[x] + degree[next-x]) or 
(sibling[next-x] + NIL and degree[sibling[next-x]] = degree[x]) 
11. then prev-x <x => case 1 and 2 
12. x < next-x => case 1 and 2 
13. else if key[x] < key[next-x] 
14. then sibling[x] < sibling[next-x] => case 3 
15. BINOMIAL-LINK(next-x, x) => case 3 
16. elseif prev-x = NIL => case 4 
17. then head[H] < next-x => case 4 
18. else sibling[prev-x] < next-x => case 4 
19. BINOMIAL-LINK(q, next-x) => case 4 
20. x < next-« => case 4 
21. next-x < sibling[x] 
22. return H 
BINOMIAL-HEAP-MERGE(H,, H,) 
1. a<head[H,] 
b < head[H,] 
head[H,] « min-degree (a, b) 
if head[H,] = NIL 
return 
if head[H,] =b 
then b <a 
a < head[H,] 
while 6 NIL 


BOSONS R WNP 


WaONAaP WN 
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10. doifsibling[a] = NIL 

11. then sibling[a] <b 

12. return 

13. else if degree [sibling[a]] < degree[b] 

14. thena < siblingla] 

15. elsec < sibling|[d] 

16. sibling[d] < siblingla] 

17. sibling[a] <b 

18. a< sibling[a] 

19. bec 

There are four cases/conditions that occur while performing union 
on binomial heaps. 

Case 1: When degree[x] # degree[next-x] = degree [sibling[next-x]], then 
pointers moves one position further down the root list. 


sibling 
prev-x x next-x  [next-x] prev-Xx x next-x 
8 ES. 2% = aK PS a ES 
B, By Casel B, By 
(a) Fig. 2.19.1. ©) 


Case 2: It occurs when x is the first of three roots of equal degree, that is, 
degree[x] = degree[next-x] = degree[sibling[next-x]], then again pointer 
move one position further down the list, and next iteration executes either 
case 3 or case 4. 


sibling 
prev-x x next-x  [next-x] prev-x x next-x 
->(a)—> 0) ©) > @_--->@) 0) OO 
Zs 2s LS 2 Le LS LS ES 
By By B, Case 2 BBY By 
(a) Fig. 2.19.2. (6) 


Case 3 : If degree[x] = degree[next-x] # degree [sibling[next-«]] and keyI[x] 
< key|next-x], we remove next-x from the root list and link it to x, creating 
B,,, tree. 
sibling 
prev-x x next-x _ [next-x] prev-x x next-x 


key [x] = key [next-x] 
(a) 





Fig. 2.19.3. (b) 
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Case 4: degree[x] = degree[next-x] # degree[sibling[next-x] and key[next-x] 
< key x, we remove x from the root list and link it to next-x, again creating 
aB,,, tree. 


sibling 
prev-x x next-x _ [next-x] prev-x x next-x 
-2@—+-Q+O+@+  ---+@--+O-- 
IS L Ly Ls Has 
By Bx Bh Case 4 GS By By 
key [x] > key [next-x] i 
\ By ) 
(a) Brat 
Fig. 2.19.4. (b) 


Time complexity of union of two binomial heap is O(log 7). 


Que 2.20. | Explain properties of binomial heap. Write an algorithm 


to perform uniting two binomial heaps. And also to find Minimum 


key. AKTU 2017-18, Marks 10 
Answer | 


Properties of binomial heap : Refer Q. 2.18, Page 2-33B, Unit-2. 

Algorithm for union of binomial heap : Refer Q. 2.19, Page 2—33B, 

Unit-2. 

Minimum key : 

BINOMIAL-HEAP-EXTRACT-MIN (#): 

1. Find the root x with the minimum key in the root list of H, and remove 
x from the root list of H. 

2. H'«MAKE-BINOMIAL-HEAP( ). 

Reverse the order of the linked list of x’s children, and set head[H"] to 

point to the head of the resulting list. 

4, H-+«< BINOMIAL-HEAP-UNION(H, #7). 

5. Return x 

Since each of lines 1-4 takes O(log n) time of H has n nodes, BINOMIAL- 

HEAP-EXTRACT-MIN runs in O(log 7) time. 


Que 2.21. | Construct the binomial heap for the following sequence 
of number 7, 2, 4, 17, 1, 11, 6, 8, 15. 


wo 


Answer 


| 


Numerical : 
Insert 7: 


yHead [H] 
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Insert 2: 


x next-x 


~O—®) 


Head [H] 
prev-x = NIL 
degree [x] = 0. So, degree [x] # degree [next-x] is false. 
degree [next-x] = 0 and Sibling [next-x] = NIL 
So, case 1 and 2 are false here. 
Now key [x] = 7 and key [next-x] = 2 
Now prev-x = NIL 
then Head [H] < next-x and 


L.e., 
Head [H] 


and BINOMIAL-LINK (, next-x) 


Le., 


Now 


Head [H] 3 x 
and next-x = NIL 


So, after inserting 2, binomial heap is 


Head [H] 


Insert 4: 


next-x 


x 


@ 
degree [x] + degree [next-x] 
So, Now next-x makes x and x makes prev-x. 
Now next-« = NIL 
So, after inserting 4, final binomial heap is : 
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Head [H] 
(7) 
Insert 17: 


After Binomial-Heap-Merge, we get 
x next-x 


O— 2) 2) 
@ 





degree [x] = degree [next-x] 

degree [Sibling-[next-«]] + degree [x] 
key [x] < key [next-x] 

4<17 [True] 

So, 


and call Binomial-Link [next-x, x] 





We get 


next-x 


()}—)* 


degree [x] = degree [next-«] 
Sibling [next-x] = NIL 

Key [x] < key [next-x] [False] 
prev-x = NIL then 

Head [H] < [next-x] 
Binomial-Link [x, next-x] 


x < next-x 
Head [H] 


2) 


4) 
@ next-x = NIL 
a7) 
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So, after inserting 17, final binomial heap is : 


Head [H] x 
e @ 
7) 


degree [x] + degree [next-x] 
So, next-x makes x and next-x = NIL 
and after inserting 1, binomial heap is: 


Head [H] (1) (2) 
(4) 
@) 
G7) 
Insert 11: 


After Binomial-Heap-Merge, we get 
x next-x 


Head [H] (1) (11) (2) 
Y @ 
a7) 


degree [x] = degree [next-«] 
degree [Sibling [next-x]] + degree [x] 
key [x] < key [next-x] [True] 


Insert 1: 
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So, 


degree [x] + degree [next-x] 
So, next-x makes x and next-x = NIL 
and final binomial heap after inserting 11 is 


Head [H] (1) (2) 
4) 4) @® 
a7) 


next-x 


xX 
Head [H]->(6) (1) (2) 
(7) 


Insert 6: 


degree [x] + degree [next-x] 

So, next-x becomes x 

Sibling [next-x] becomes next-x. 
L.e., 
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degree [x] # degree [next-x] 
So, no change and final heap is : 


Head [H] (6) (1) (2) 
(7) 


Insert 8: 


a 
=] 
oO 
* 
+ 
ta 


degree [x] = degree [next-«] 

degree [Sibling [next-x]] + degree [x] 
key [x] < key [next-x] [True] 

So, 


degree [x] = degree [next-«] 

degree [Sibling p[next-x«]] < degree [x] 
key [x] < key [next-x] [False] 

prev-x = NIL 

So, 
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degree [x] = degree [next-«] 
Sibling [next-x] = NIL 

key [x] < key [next-«] [True] 
So, Sibling [x] = NIL. 

and 


next [x] = NIL 
So, this is the final binomial heap after inserting 8. 
Insert 15: 


x next-x 


Head [H] (15) (1) 
Geo 
(8) O © 


degree [x] # degree [next-x] 
So, no change and this is the final binomial heap after inserting 15. 


Que 2.22. | Explain the algorithm to delete a given element in a 


binomial heap. Give an example for the same. 


AKTU 2019-20, Marks 07 
Answer | 


Deletion of key from binomial heap: 

The operation BINOMIAL-HEAP-DECREASE (H, x, 2) assigns a new key ‘k’ 
to anode ‘x’ in a binomial heap H. 

BINOMIAL-HEAP-DECREASE-KEY (H, x, k) 

1. ifk>key [x] then 

2. Message “error new key is greater than current key” 

3. keylxl<k 
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4, yeu 

5. z2¢Plyl 

6. While (z # NIL) and key [y] < key [z] 
7. do exchange key [y] < key [z] 

9 yee 

10. z< Phy] 


Deleting a key : The operation BINOMIAL-HEAP-DELETE 
(H, x) is used to delete a node x’s key from the given binomial heap H. The 
following implementation assumes that no node currently in the binomial 
heap has a key of — ». 

BINOMIAL-HEAP-DELETE (H, x) 
1. BINOMIAL-HEAP-DECREASE-KEY (H, x, — 0) 
2. BINOMIAL-HEAP-EXTRACT-MIN(A) 
For example : Operation of Binomial-Heap-Decrease (H, x, k) on the 
following given binomial heap : 
Suppose a binomial heap H is as follows : 





Now, the linked list of x’s children is reversed and set head[H'] to point to the 
head of the resulting list, i.e., another binomial heap H’. 
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Head[H']—»(25) (12) 





Now, call BINOMIAL-HEAP-UNION (H, H’) to uniting the two binomial 
heaps H and H'. The resulting binomial heap is 


Head[H] 





PART-4 


Fibonacci Heaps. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 2.23. | What is a Fibonacci heap ? Discuss the applications of 


Fibonacci heaps. 


Answer 


| 


1. A Fibonacci heap is a set of min-heap-ordered trees. 


2. Trees are not ordered binomial trees, because 
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a. Children of a node are unordered. 
b. Deleting nodes may destroy binomial construction. 
min(H) 





65) Fig. 2.23.1. 


3. Fibonacci heap H is accessed by a pointer min[H] to the root of a tree 
containing a minimum key. This node is called the minimum node. 

4. IfFibonacci heap H is empty, then min[H] = NIL. 

Applications of Fibonacci heap : 

1. Fibonacci heap is used for Dijkstra’s algorithm because it improves the 
asymptotic running time of this algorithm. 

2. It is used in finding the shortest path. These algorithms run in O(n?) 
time if the storage for nodes is maintained as a linear array. 


Que 2.24. | What is Fibonacci heap ? Explain CONSOLIDATE 


operation with suitable example for Fibonacci heap. 


AKTU 2015-16, Marks 15 
Answer | 


Fibonacci heap: Refer Q. 2.23, Page 2-44B, Unit-2. 
CONSOLIDATE operation : 

CONSOLIDATE (A) 

for i < 0 to Din|A]) 

do A[i] — NIL 

for each node w in the root list of H 

dox<w 

d < degree[x] 

while A[d] # NIL 

do y < Ald] p Another node with the same degree as x. 
if key[x] > key[y] 

then exchange x > y 

10. FIB-HEAP-LINK(H, y, x) 

11. Ald] < NIL 

12. d«d+1l 

13. Ald] <x 

14. min[H] < NIL 

15. fori < 0 to Dim[A)) 

16. doif Ali] NIL 

17. then add A[i] to the root list of H 


CaANAAPWON Ee 
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18. if min[H] = NIL or key [AIi]] < key[min[H]] 
19. then min[H] < Alz] 

FIB-HEAP-LINK(H, y, x) 

1. remove y from the root list of H 

2. make y a child of x, incrementing degree[x] 
3. mark[y] < FALSE 


Que 2.25. | Define Fibonacci heap. Discuss the structure of a 


Fibonacci heap with the help of a diagram. Write a function for 
uniting two Fibonacci heaps. 


Answer | 


Fibonacci heap : Refer Q. 2.23, Page 2-44B, Unit-2. 
Structure of Fibonacci heap : 
1. Node structure: 
a. The field “mark” is True if the node has lost a child since the node 
became a child of another node. 
b. The field “degree” contains the number of children of this node. 
The structure contains a doubly-linked list of sibling nodes. 


Parent 


Key 
Mark 
Degree 


Left Right 


Child 





Fig. 2.25.1. Node structure. 


2. Heap structure: 
min(A) : Fibonacci heap H is accessed by a pointer min|H] to the root of 
atree containing a minimum key; this node is called the minimum node. 
If Fibonacci heap H is empty, then min[H] = NIL. 
n(H) : Number of nodes in heap H 
min(H) 





Fig. 2.25.2. Heap structure. 
Function for uniting two Fibonacci heap : 
Make-Heap: 
MAKE-FIB-HEAP( ) 
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allocate(H) 

min(H) = NIL 

n(H) = 0 

FIB-HEAP-UNION(Z,, H,) 

H < MAKE-FIB-HEAP( ) 

min[H] <— min[H,] 

Concatenate the root list of H, with the root list of H 
if (min[H] = NIL) or (min[H,] # NIL and min[H,] < min[H,]) 
then min[H] <— min[H,] 

nl[H] <— n{H,] + n[H,] 

Free the objects H, and H, 

return H 


Que 2.26. | Discuss following operations of Fibonacci heap : 


i. Make-Heap 
ii. Insert 

iii. Minimum 
iv. Extract-Min 


Answer | 


i. Make-Heap: Refer Q. 2.25, Page 2-46B, Unit-2. 

ii. Insert: (H, x) 

degree[x] < 0 

pix] <— NIL 

child[x] <— NIL 

left[x] < x 

right[x] <x 

mark[x] < FALSE 

concatenate the root list containing x with root list H 

if min[H] = NIL or key[x] < key[min[H]] 

then min[H] < x 

n|H] < n[H] +1 

To determine the amortized cost of FIB-HEAP-INSERT, Let H be the 

input Fibonacci heap and H” be the resulting Fibonacci heap, then 

t(H) = t(H) + 1 and m(A’) = m(A), and the increase in potential is, 

(t(H) + 1) + 2m(A) - (t(A) + 2m(A)) =1 

Since the actual cost is O(1), the amortized cost is O(1) + 1 = O(1) 

iii. Minimum: 
The minimum node of a Fibonacci heap H is always the root node given 
by the pointer min[H], so we can find the minimum node in O(1) actual 
time. Because the potential of H does not change, the amortized cost of 
this operation is equal to its O(1) actual cost. 

iv. FIB-HEAP-EXTRACT-MIN(@) 

z<min[H] 

ifz# NIL 

then for each child x of z 
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12. 


do add x to the root list of H 
pix] <— NIL 

remove z from the root list of H 
if z = right[z] 

then min[H] < NIL 

else min[H] < right|z] 


CONSOLIDATE (#1) 
. n[H] <—n[H]-1 
return z 


PART-5 


Tries, Skip List. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 2.27. | What is trie ? What are the properties of trie ? 


Answer | 


1. 


A trie (digital tree / radix tree / prefix free) is a kind of search tree i.e., an 
ordered tree data structure that is used to store a dynamic set or 
associative array where the keys are usually strings. 


Unlike a binary search tree, no node in the tree stores the key associated 
with that node; instead, its position in the tree defines the key with 
which it is associated. 


All the descendants of a node have a common prefix of the string 
associated with that node, and the root is associated with the empty 
string. 

Values are not necessarily associated with every node. Rather, values 
tend only to be associated with leaves, and with some inner nodes that 
correspond to keys of interest. 


Properties of a trie: 


1. 


2. 
3. 
4 


Trie is a multi-way tree. 
Each node has from 1 to d children. 
Each edge of the tree is labeled with a character. 


Each leaf node corresponds to the stored string, which is a concatenation 
of characters on a path from the root to this node. 


Que 2.28. | Write an algorithm to search and insert a key in trie 


data structure. 
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Answer | 


Search a key in trie: 

Trie-Search(¢, P[k..m]) // inserts string P into t 

1. iftis leaf then return true 

2. else ift.child(P[A]) = nil then return false 

3. else return Trie-Search(t.child(P[k]), P[k + 1..m]) 
Insert a key in trie: 

Trie-Insert(¢, P[k..m]) 

1. iftis not leaf then //otherwise P is already present 
2. ift.child(P[A]) = nil then 


//Create a new child of t and a “branch” starting with that child and 
storing P[k..m] 


8. else Trie-Insert(t.child(P[k]), Pik + 1..m]) 





Que 2.29. | What is skip list ? What are its properties ? 


Answer | 


Askip list is built in layers. 
The bottom layer is an ordinary ordered linked list. 


wnr 


Each higher layer acts as an “express lane”, where an element in layer 
i appears in layer (i + 1) with some fixed probability p (two commonly 
used values for p are and .). 


- 


On average, each element appears in 1/(1—p) lists, and the tallest element 
(usually a special head element at the front of the skip list) in all the lists. 


5. The skip list contains log, ,,n (i.c., logarithm base 1/p of n). 
Properties of skip list : 


1. Some elements, in addition to pointing to the next element, also point to 
elements even further down the list. 


A level k element is a list element that has k forward pointers. 

The first pointer points to the next element in the list, the second pointer 
points to the next level 2 element, and in general, the i* pointer points 
to the next level i element. 


Que 2.30. | Explain insertion, searching and deletion operation in 
skip list. 


Answer | 


Insertion in skip list : 


~ 


1. Wewill start from highest level in the list and compare key of next node 
of the current node with the key to be inserted. 














Advanced Data Structure 2-50 B (CS/IT-Sem-5) 





2. If key of next node is less than key to be inserted then we keep on 
moving forward on the same level. 


3. Ifkey of next node is greater than the key to be inserted then we store 
the pointer to current node i at update[i] and move one level down and 
continue our search. 


At the level 0, we will definitely find a position to insert given key. 
Insert(list, searchKey) 

local update[0...MaxLevel+1] 

x := list — header 

for i : = list — level down to 0 do 

while x > forward|i] > key forward[i] 

updatel[z] : =x 

x:=x — forward|[0] 

lvl : = randomLevel() 

if lvl > list — level then 


OP aonNnoarpon pr 


for i : = list > level + 1 to lvl do 

10. updatel[z] : = list ~ header 

11. list > level: =lvl 

12. x:=makeNode(lvl, searchKey, value) 
13. for i:=0 to level do 

14. x > forward|[i] : = update[i] > forward|[i] 
15. update[i] > forward|[i] : =x 


Searching in skip list : 
Search (list, searchKey) 


1. x«:=list > header 

2. loop invariant : x > key level down to 0 do 

3. while x > forward[i] > key forward|i] 

4. x:=x — forward|[0] 

5. ifx > key =searchKey then return x > value 
6. else return failure 


Deletion in skip list : 
Delete(list, searchKey) 


1. local update[0..MaxLevel+1] 

2. x«:=list — header 

3. for i:=list > level down to 0 do 

4. while x > forward[i] > key forward|i] 
5. updateli] : =x 
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6. x:=x —> forward|[0] 

7. ifx — key = searchKey then 

8. fori: =0 to list > level do 

9. if update[i] — forward|[i] + x then break 

10. update[i] > forward|[i] : = x > forward|i] 

11. free(x) 

12. while list > level >0 and list > header > forward|list — level] = NIL do 
13. list > level: = list > level—1 


Que 2.31. | Given an integer x and a positive number n, use divide 


and conquer approach to write a function that computes x” with 


time complexity O(log 7). AKTU 2018-19, Marks 10 
Answer | 


Function to calculate x” with time complexity O(log n) : 
int power(int x, unsigned int y) 
{ 

int temp; 

if(y == 0) 

return 1; 

temp = power‘(x, y/2); 

if (y%2 == 0) 

return temp * temp; 

else 

return x * temp * temp; 


} 








VERY IMPORTANT QUESTIONS 


Following questions are very important. These questions 
may be asked in your SESSIONALS as well as 


UNIVERSITY EXAMINATION. 








Q.1. Define red-black tree and give its properties. 
Ans: Refer Q. 2.1. 


Q.2. Insert the following element in an initially empty RB-Tree. 
12, 9, 81, 76, 23, 43, 65, 88, 76, 32, 54. Now delete 23 and 81. 
Ans: Refer Q. 2.7. 
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Q. 3. 
Ans. 
Q.4 


Ans. 


Q. 5. 


Ans. 
Q. 6. 
Ans. 
Q. 7. 
Ans. 


Q. 8. 
Ans. 


Q. 9. 
Ans. 


Q. 10. 
Ans. 


Define a B-tree of order m. Explain the searching and 
insertion algorithm in a B-tree. 
Refer Q. 2.10. 


Explain the insertion and deletion algorithm in a red-black 
tree. 

Insertion algorithm : Refer Q. 2.1. 

Deletion algorithm : Refer Q. 2.5. 


Using minimum degree “’ as 3, insert following sequence of 
integers 10, 25, 20, 35, 30, 55, 40, 45, 50, 55, 60, 75, 70, 65, 80, 85 
and 90 in an initially empty B-Tree. Give the number of 
nodes splitting operations that take place. 

Refer Q. 2.17. 


What is binomial heap ? Describe the union of binomial 
heap. 
Refer Q. 2.19. 


What is a Fibonacci heap ? Discuss the applications of 
Fibonacci heaps. 
Refer Q. 2.23. 


What is trie ? Give the properties of trie. 
Refer Q. 2.27. 


Explain the algorithm to delete a given element in a binomial 
heap. Give an example for the same. 
Q. 2.22. 


Explain skip list. Explain its operations. 


Skip list : Refer Q. 2.29. 
Operations : Refer Q. 2.30. 


OOO 
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PART- 1 


Divide and Conquer with Examples such as 
Sorting, Matrix Multiplication, Convex Hull, Searching. 





Questions-Answers 





Long Answer Type and Medium Answer Type Questions 


Que 3.1. | Write short note on divide and conquer. Write algorithm 


for merge sort and quick sort. 


Answer | 


Divide and conquer : 





1. Divide and conquer is an algorithm design paradigm based on multi- 
branched recursion. 


i) 


A divide-and-conquer algorithm works by recursively breaking down a 
problem into two or more sub-problems of the same or related type, 
until these become simple enough to be solved directly. 


3. The solutions to the sub-problems are then combined to give a solution 
to the original problem. 


4. Divide and conquer technique can be divided into the following three 
parts: 


a. Divide: This involves dividing the problem into some sub-problem. 
b. Conquer: Recursively calling sub-problem until it is solved. 


ec. Combine : This involves combination of solved sub-problem so 
that we will get the solution of problem. 


Merge Sort : Refer Q. 1.21, Page 1-20B, Unit-1. 
Quick Sort : Refer Q. 1.19, Page 1-16B, Unit-1. 


Que 3.2. | What is matrix chain multiplication problem ? Describe 


a solution for matrix chain multiplication problem. 


Answer | 


1. Matrix chain multiplication (or Matrix Chain Ordering Problem, MCOP) 
is an optimization problem that can be solved using dynamic 
programming. 

2. MCOP helps to find the most efficient way to multiply given matrices. 
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3. Solution for matrix chain multiplication problem is Strassen’s matrix 
multiplication. 


Strassen’s matrix multiplication : 
1. Itis an application of divide and conquer technique. 


2. Suppose we wish to compute the product C = AB where each A, B and C 
are n x n matrices. 


3. Assuming that n is an exact power of 2. We divide each of A, B and Cinto 
four n/2 x n/2 matrices. 


Rewriting the equation C = AB as 


(r s\ (a b\(e g) 
bag ~ be a) GP (3.2.1) 


4. For convenience, the sub-matrices of A are labelled alphabetical from 
left to right, whereas those of B are labelled from top to bottom. So that 
matrix multiplication is performed. 


Equation (3.2.1) corresponds to the four equations : 


r=ae+bf ...(3.2.2) 
s=agt+bh ...(3.2.3) 
t=ce+df ...(3.2.4) 
u=cg+dh ..(3.2.5) 


5. Each of these four equations specifies two multiplications of 
n/2 x n/2 matrices and the addition of their n/2 x n/2 products. 


6. Using these equations to define a straight-forward divide and conquer 
strategy. We derive the following recurrence for the time T(7) to multiply 
two n x n matrices : 


T(n) = 8T (n/2) + O(n?) 


Unfortunately, this recurrence has the solution T(n) = ©(n*) and thus, 
this method is no faster than the ordinary one. 


_ 


Que 3.3. | Describe in detail Strassen’s matrix multiplication 


algorithms based on divide and conquer strategies with suitable 
example. 


Answer 


| 


Strassen’s matrix multiplication algorithm has four steps : 
1. Divide the input matrices A and B into n/2 x n/2 sub-matrices. 


2. Using O(n?) scalar additions and subtraction compute 14 
n/2 x n/2 matrices A,, B,, A,, B,, ...A,, B,. 


3. Recursively compute the seven matrix products. 
P.=AB, fori = 1, 2,3, ...,7 
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4. Compute the desired sub-matrices r, s, t, u of the result matrix C by 
adding and/or subtracting various combinations of the P, matrices using 
only ©(n?) scalar additions and subtractions. 


C. C. 
Suppose, A = A, Aig B= Ee “a and C = ns al 
Ay; Aggy Boy Byg Co, Cog 


Ay Ay} | Bi Bi |_ Es a 
Pe i fe Ss (Co, Cop 
In Strassen method first compute the 7 n/2 x n/2 matrices. 
P,Q, R,S, T, U, V as follows : 
P= (Ay +A,,) B,, + B,,) 
Q = (A,, + A,,) By, 
R=A,, (B,, - B,,) 
S=A,, (B,, - B,,) 
T=(A,,+A,,) B,, 
U=(A,, -A,,) (B,, + B,) 
V=(A,, —A,,)) B,, + By,) 
Then the c,’s are computed using the formulas 
c¢,,=P+S-T+V 
¢,=R+T 
C,=Q+8 
Cy =P+R-Q+U 
As can be seen P, Q, R, S, T, U and V can be computed using 7 matrix 


multiplication and 10 matrix addition or subtraction and c,’s require an 
additional 8 addition or subtraction. 


For example: 


Suppose, 
azl2 %lpel/4 Be a 
5 6 8 7 Cor Cop 
AB=C 
2974 11] [C, Cs 
5 618 7] [Co Coo 
So, A,, = 2,B,,=4 
A,, = 9,B,,=11 
A,, = 5, B,, = 
A,, = 6, B,,=7 
Now calculate, 
S,=B,,-B,,=5, S,= B,,+B,,=15 
S,=A,,+A,,=11, S,=A,,-A,, =3 
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S,=A,,+A,,.= 11, S,= B,,+B,, = 15 
S,=B8,,-B,=4, S,=A,,—A,, = 
S,=A,, +A, =8, S,,=B,,+B,,=15 

Now, R=A,, x S,=10, P=S,xS,=120 
T=S, x B,,= 77, U=S,xS,=45 
Q=S, x B,, = 44, V=S,xS,,= 45 
S=A,,x S,= 24 

Now, C,,=P+S-T+V=88 + 24—77+45 = 80 


C,,=R+T=10+77=87 

Cy, = Q+S = 44424 =68 

C,, =P +R-Q+U = 88+ 10-44 + 45 = 99 
80 A 


Now matrix = i 99 


Que 3.4. | What do you mean by graphs ? Discuss various 
representations of graphs. 


Answer | 


1. Agraph G consists of a set of vertices V and a set of edges E. 


2. Graphs are important because any binary relation is a graph, so graphs 
can be used to represent essentially any relationship. 


Fig. 3.4.1. 

Various representations of graphs : 

1. Matrix representation : Matrices are commonly used to represent 
graphs for computer processing. Advantage of representing the graph 
in matrix lies in the fact that many results of matrix algebra can be 
readily applied to study the structural properties of graph from an 
algebraic point of view. 

a. Adjacency matrix: 

i. Representation of undirected graph: 
The adjacency matrix of a graph G with n vertices and no 
parallel edges is a n x n matrix A = [a,,] whose elements are 
given by 
a, = 1, if there is an edge between i and j vertices 

= 0, if there is no edge between them 
ii. Representation of directed graph : 


The adjacency matrix of a digraph D, with n vertices is the 
matrix 
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A= [aT nen in which 
a= lifarc (v,, v,) isin D 
= 0 otherwise 
b. Incidence matrix: 


i. Representation of undirected graph: 


Consider an undirected graph G = (V, E) which has n vertices 
and m edges all labelled. The incidence matrix [(G) = [6,, is 
then n x m matrix, where 
6, = 1 when edge e, is incident with v, 
=0 otherwise 
ii. Representation of directed graph: 


The incidence matrix [(D) = [0,1] of digraph D with n vertices 
and m edges is the n x m matrix in which. 


6, = lif arc jis directed away from vertex v, 
= —1ifarc is directed towards vertex v, 
= 0 otherwise. 


Linked representation : 
a. In linked representation, the two nodes structures are used : 


i. For non-weighted graph, 


ii For weighted graph, 


Where Adj-list is the adjacency list i.e., the list of vertices which are 
adjacent for the corresponding node. 


b. The header nodes in each list maintain a list of all adjacent vertices 
of that node for which the header node is meant. 


Que 3.5. | Explain DFS. Also give DFS algorithm. 


Answer | 


Depth First Search Algorithm : 


1. 


Algorithm starts at a specific vertex S in G, which becomes current 
vertex. 

Then algorithm traverse graph by any edge (u, v) incident to the current 
vertex u. 

If the edge (uw, v) leads to an already visited vertex v, then we backtrack 
to current vertex u. 

If, on other hand, edge (uw, v) leads to an unvisited vertex v, then we go 
to v and v becomes our current vertex. 


We proceed in this manner until we reach to “dead end”. At this point we 
start backtracking. 
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6. Theprocess terminates when backtracking leads back to the start vertex. 


7. Edges leads to new vertex are called discovery or tree edges and edges 
lead to already visited vertex are called back edges. 


Algorithm : 


In DFS, each vertex v has two timestamps : the first timestamp d[v] i.e., 
discovery time records when v is first discovered i.e., grayed, and the second 
timestamp /[v] i.e. finishing time records when the search finishes examining 
v’s adjacency list i.e., blacked. For every vertex d[u] < flu]. 
DFS(G): 
for each vertex u € V[G] 
do color[u] < WHITE 
mlu] < NIL 
time < 0 
for each vertex u € V[G] 
do if color[u] = WHITE 
: then DFS-VISIT(w) 
F'S-VISIT(u): 
color[u] < GRAY // White vertex u has just been discovered. 
time < time +1 
d[u] < time 
for each v € Adj[u] // Explore edge (u, v) 
do if color[v] = WHITE 
then zlv] < u 
DFS-VISIT (v) 
color[u] < BLACK // Blacken u, it is finished. 
flu] < time < time + 1 


Que 3.6. | Explain Breadth First Search (BFS). Give its algorithm. 


Answer | 


Breadth first search : 
1. The general idea behind a breadth first search is as follows : 


CON AAPWONPOENSOarwone 


a. First we examine the starting node A. 
b. Then, we examine all the neighbours of A, and so on. 


~) 


Naturally, we need to keep track of the neighbours of a node, and we 
need to guarantee that no node is processed more than once. 


3. This is accomplished by using a queue to hold nodes that are waiting to 
be processed. 


Algorithm : 

BFS (G, s): 

1. for each vertex u < V[G] — {s} 
2: do color[u] < WHITE 
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Que 3.7. 


13 
14 
15 
16 
17 
18. 
Gesell 


d[u] < 2% 
mlu] < NIL 
color[s] <- GRAY 
dls] <0 
mls] <— NIL 
Q<—4> 
ENQUEUE(Q, s) 


. while Q¥¢ 


doc 
dou < DEQUEUE(Q) 
for each v € Adj[u] 
do if color [v] = WHITE 
then color|[v] < GRAY 
d{v) <d[u] +1 
mv] <u 
ENQUEUE(Q, v) 
color[u] < BLACK 


connected or not. 


Answer 


Answer | 


Test-connected (G): 


1. 


~) 


Choose a vertex x 
Make a list L of vertices reachable from x, 


and another list K of vertices to be explored. 


Initially, Lb=K=x. 

while K is non-empty 

Find and remove some vertex y in K 
for each edge (y, z) 

if (z is not in L) 

Add z to both L and K 

if L has fewer than n items 


return disconnected 


. else return connected. 


Write an algorithm to test whether a given graph is 


Que 3.8. | Discuss strongly connected components with its 
algorithm. 
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Answer | 


1. The Strongly Connected Components (SCC) of a directed graph G are 
its maximal strongly connected subgraphs. 





2. Ifeachstrongly connected component is contracted to a single vertex, the 
resulting graph is a directed acyclic graph called as condensation of G. 


3. Kosaraju’s algorithm is an algorithm to find the strongly connected 
components of a directed graph. 


Kosaraju’s algorithm : 
1. Let Gbe a directed graph and S be an empty stack. 
2. While S does not contain all vertices : 
i. Choose an arbitrary vertex v not in S. Perform a depth first search 
starting at v. 
iii Each time that depth first search finishes expanding a vertex u, 
push u onto S. 
3. Reverse the direction of all arcs to obtain the transpose graph. 
While S is non-empty : 
i. Pop the top vertex v from S. Perform a depth first search starting at 
Uv. 


ii. Theset of visited vertices will give the strongly connected component 
containing v; record this and remove all these vertices from the 
graph G and the stack S. 


Que 3.9. | Explain convex hull problem. 
AKTU 2017-18, Marks 10 
OR 


Discuss convex hull. Give Graham-Scan algorithm to compute 
convex hull. 

OR 
What do you mean by convex hull ? Describe an algorithm that 
solves the convex hull problem. Find the time complexity of the 


algorithm. AKTU 2019-20, Marks 07 
Answer | 


1. The convex hull of a set S of points in the plane is defined as the smallest 
convex polygon containing all the points of S. 


2. The vertices of the convex hull of aset S of points form a (not necessarily 
proper) subset of S. 

3. Tocheck whether a particular point p < S is extreme, see each possible 
triplet of points and check whether p lies in the triangle formed by these 
three points. 
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Fig. 3.9.1. 


If p lies in any triangle then it is not extreme, otherwise it is. 


5. We denote the convex hull of S by CH(S). Convex hull is a convex set 
because the intersection of convex sets is convex and convex hull is also 
a convex closure. 


Graham-Scan algorithm : 


The procedure GRAHAM-SCAN takes as input a set Q of points, where 

|Q| =3. It calls the functions Top(S), which return the point on top of stack 
S without changing S, and to NEXT-TO-TOP(S), which returns the point one 
entry below the top of stack S without changing S. 


GRAHAM-SCAN(Q) 


1. Let p, be the point in Q with the minimum y-coordinate, or the leftmost 
such point in case of a tie. 


2. Let <p,,),,....,p,,> be the remaining points in Q, sorted by polar angle in 
counter clockwise order around p, (if more than one point has the same 
angle remove all but the one that is farthest from p,). 


Top [S] <0 

PUSH (p,, S) 

PUSH (p,, S) 

PUSH (p,, S) 

fori<-3tom 
do while the angle formed by points NEXT-To-TOP(S), Top(S), and 
p, makes a non left turn. 

9. do POP(S) 

10. PUSH (p,, S) 

11. returnS 


aro k w 


Time complexity : 
The worst case running time of GRAHAM-SCAN is 

T(n) = O(n) + O(n log n) + O(1) + O(n) = Om log n) 
where n= |Q| 


Graham’s scan running time depends only on the size of the input it is 
independent of the size of output. 
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PART-2 


Greedy Methods with Examples such as Optimal 
Reliability Allocation. 








Questions-Answers 





Long Answer Type and Medium Answer Type Questions 


Que 3.10. | Write note on the greedy algorithm. 


Answer | 
1 


Greedy algorithms are simple and straight forward. 





Greedy algorithms are shortsighted in their approach in the sense that 
they take decisions on the basis of information at hand without worrying 
about the effect these decisions may have in the future. 


3. Greedy algorithms are easy to invent, easy to implement and most of 
the time quite efficient. 

4. Many problems cannot be solved correctly by greedy approach. 

5. Greedy algorithms are used to solve optimization problems. 


Que 3.11. | What are the four functions included in greedy 


algorithm ? Write structure of greedy algorithm. 


Answer | 


The greedy algorithm consists of four functions : 
i. A function that checks whether chosen set of items provide a solution. 
A function that checks the feasibility of a set. 
iti, The selection function tells which of the candidates are most promising. 
iv. Anobjective function, which does not appear explicitly, gives the value 
of a solution. 
Structure of greedy algorithm : 
i. Initially the set of chosen items is empty i.e., solution set. 
ii. Ateachstep 
a. Item will be added in a solution set by using selection function. 
b. Ifthe set would no longer be feasible 
Reject items under consideration (and is never consider again). 


p: 


c. Else ifset is still feasible 
add the current item. 
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Que 3.12. | Define activity selection problem and give its solution 


by using greedy approach with its correctness. 


Answer | 


1. An activity selection is the problem of scheduling a resource among 
several competing activity. Given a set S = {1, 2, ..., n} of n activities. 


Each activity has s, a start time, and f,a finish time. 


ey 


If activity i is selected, the resource is occupied in the intervals (s,, f,). We 
say i andj are compatible activities if their start and finish time does not 
overlap i.e., i andj compatible ifs, 2, and s, 2 f, 

4. The activity selection problem is, to select a maximal sized subset of 
mutually compatible activities. 


Here we maximize the number of activities selected, but if the profit were 
proportional to s,—f,, this will not maximize the profit. 
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Greedy algorithm : 
Assume that /, </f, <...<f, 
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Greedy-Activity-Selector (s, f) 
1. n< length [s] 
2. A<{a,} 

38. tel 

4. form<2ton 
5. do ifs, =f, 
6 then A — Av {(m)} 

7 i<m 

8. return A 

The algorithm starts with {1} and checks to see which can be added after 1, 
updating the global “finishing time” and comparing with each start time. 


The activity picked is always the first that is compatible. Greedy algorithms 
do not always produce optimal solutions. 


Correctness : Greedy algorithm does not always produce optimal solutions 
but GREEDY-ACTIVITY-SELECTOR does. 


Que 3.13. | What are greedy algorithms ? Find a solution to the 


following activity selection problem using greedy technique. The 
starting and finishing times of 11 activities are given as follows: 
(2, 3) (8, 12) (12, 14) (3, 5) (0, 6) (1, 4) (6, 10) (5, 7) (3, 8) (5, 9) (8, 11) 

OR 
What is greedy approach ? Write an algorithm which uses this 
approach. 


Answer | 


Greedy algorithm : Refer Q. 3.10, Page 3-11B, Unit-3. 

Greedy approach : Greedy approach works by making the decision that 
seems most promising at any moment it never reconsiders this decision, 
whatever situation may arise later. Activity selection problem uses greedy 
approach. 

Algorithm for greedy activity selection : Refer Q. 3.12, Page 3-12B, 
Unit-3. 

Numerical : 


Sorted activities} a, 


Starting time 
























Finish time 





We select first activity a, 
(2, 3) 
Check for activity a, 


Starting time ofa, 4 time ofa, 
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*. a, is not selected 
Check for activity a, 
Starting time ofa, > finish time ofa, 
. a, is selected 
Check for activity a, 
Starting time ofa, 4 finish time ofa, 
a, is not selected 
Check for activity a, 
Starting time ofa, > finish time ofa, 
. a,is selected 
Check for activity a, 
Starting time ofa, 4 finish time ofa, 
*. a, isnot selected 
Check for activity a, 
Starting time ofa, % finish time of a 
. a, is not selected 
Check for activity a, 
Starting time ofa, 2 finish time of a, 
*. a, is not selected 
Check for activity a, 
Starting time ofa, > finish time of a, 
. ais selected 
Check for activity a,, 
Starting time ofa,, 4 finish time ofa, 
". @,, is not selected 
Check for activity a,, 


5 


Starting time ofa,, > finish time ofa, 
. a,,is selected. 
Therefore selected activities are : 


a, (2, 3) 
a, (8, 5) 
a, (5, 7) 
a, (8, 11) 
a (12, 14) 


Que 3.14. | What is “Greedy Algorithm” ? Write its pseudocode for 
recursive and iteration process. 


Answer | 


Greedy algorithm : Refer Q. 3.10, Page 3-11B, Unit-3. 
Greedy algorithm defined in two different forms : 
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SNoa fF WD 


Q 


Pseudo code for recursive greedy algorithm : 
R_A_S(s, fi,Jj) 
m<eitl 
while m<jands,, <f, 
dom<m+1 
ifm <j 
then return {a,,} UR_A_S(s, f m, j) 
else return 
Pseudo code for iterative greedy algorithm : 
G_A_S(s, f) 
n < length [s] 
A< [a,] 
tel 
m<2ton 

do ifs, =f, 

then A < A VU {a, } 
i<m 

return A 


i 


ue 3.15. | What is an optimization problem ? How greedy method 


can be used to solve the optimization problem ? 


Answer | 

1. An optimization problem is the problem of finding the best solution 
from all feasible solutions. 

2. Optimization problems can be divided into two categories depending 
on whether the variables are continuous or discrete. 

3. There is no way in general that one can specify if a greedy algorithm 
will solve a particular optimization problem. 

4. However if the following properties can be demonstrated, then it is 


probable to use greedy algorithm : 


a. Greedy choice property : A globally optimal solution can be 
arrived at by making a locally optimal greedy choice. That is, when 
we are considering which choice to make, we make the choice 
that looks best in the current problem, without considering results 
from sub-problems. - 

b. Optimal substructure: A problem exhibits optimal substructure 
if an optimal solution to the problem contains within it optimal 
solutions to sub-problems. 
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PART-3 


Knapsack. 











Questions-Answers 


Long Answer Type and Medium Answer Type Questions 


Que 3.16. | What is knapsack problem ? Describe an approach 


used to solve the problem. 





Answer 


! 


The knapsack problem is a problem in combinatorial optimization. 


Ne 


Given a set of items, each with a weight and a value, determine the 
number of each item to include in a collection so that the total weight is 
less than or equal to a given limit and the total value is as large as 
possible. 


Approach use to solve the problem : 

1. In knapsack problem, we have to fill the knapsack of capacity W, with 
a given set of items J, /,... , having weight w,, w,...w, in such a manner 
that the total weight of items cannot exceed the capacity of knapsack 
and maximum possible value (uv) can be obtained. 


2. Using branch and bound approach, we have a bound that none of the 
items can have total sum more than the capacity of knapsack and must 
give maximum possible value. 


wo 


The implicit tree for this problem is a binary tree in which left branch 
implies inclusion and right implies exclusion. 

4. Upper bound of node can be calculated as : 

ub =v + (W-w,,,) U,,, / W,,,) 


i+] 


Que 3.17. | Write greedy algorithm for discrete knapsack problem 


with example. 


Answer | 


Greedy algorithm for the discrete knapsack problem : 

1. Compute value/weight ratio v, /w, for all items. 

2. Sort the items in non-increasing order of the ratios v, /w,. 

3. Repeat until no item is left in sorted list using following steps : 
a. Ifcurrent item fits, use it. 


b. Otherwise skip this item, and proceed to next item. 
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For example : Knapsack problem for the following instance using greedy 
approach. The item can be selected or skipped completely. 

















Consider W = 10. 


Solution : This is also called 0/1 knapsack. Either we can completely select 
an item or skip it. First of all we will compute value-to-weight ratio and 
arrange them in non-increasing order of the ratio. 


4 














3 742 10.5 

1 | 7 | 749 | i | 
4 | 6 | 30 | 6 | 
2 | 3 | ze | 4 | 





To fulfill the capacity W = 10, we will have 
1. Add item of weight 4,W=10-4=6 
2. Skip item of weight 7 

3. Add item of weight 5,W=6-5=1 

4. Skip item of weight 3 

Maximum value = 10.5 + 6 = 16.5 


But the greedy algorithm does not give optimal solution always rather there 
is no upper bound on the accuracy of approximate solution. 


Que 3.18. | What is 0/1-knapsack problem ? Does greedy method 


effective to solve the 0/1-knapsack problem ? 


Answer | 


The 0/1-knapsack problem is defined as follows : 


1. Given, a knapsack of capacity c and n items of weights {wy, Wo, ..., w,} 
and profits {p,, Do, + , D,}, the objective is to choose a subset of n 
objects that fits into the knapsack and that maximizes the total profit. 


Consider a knapsack (bag) with a capacity of c. 


oo 


We select items from a list of n items. 
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Each item has both a weight of w, and profit of p,. 


In a feasible solution, the sum of the weights must not exceed the 
knapsack capacity (c) and an optimal solution is both feasible and 
reaches the maximum profit. 


An optimal packing is a feasible solution one with a maximum profit : 


n 
PyX1 + DoXg + Dgrgt --- + DyX, = 2; D;X; 
i=l 
which is subjected to constraints : 


n 
= x, < 
W4X1 + WoXy + WoXqt... + W,X, = Swix; Se 
i=l 


and x,=1 or 0, 1<i<n 


We have to find the values of x; where x, = 1 if ith item is packed into 
the knapsack and x, = 0 if ith item is not packed. 


Greedy strategies for the knapsack problem are : 


i. 


ili. 


From the remaining items, select the item with maximum profit that 
fits into the knapsack. 

From the remaining items, select the item that has minimum weight 
and also fits into the knapsack. 


From the remaining items, select the one with maximum p,/w, that 
fits into the knapsack. 


Greedy method is not effective to solve the 0/1-knapsack problem. By using 
greedy method we do not get optimal solution. 


Que 3.19. | Given the six items in the table below and a knapsack 


with weight 100, what is the solution to the knapsack problem in 
all concepts. i.e., explain greedy all approaches and find the optimal 
solution. 




















B 50 35 0.7 
Cc 40 20 0.5 
D 20 4 0.2 
E 10 10 1 

F 10 6 0.6 
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Answer | 


We can use 0/1-knapsack problem when the items cannot be divided into 
parts and fractional knapsack problem when the items can be divided into 
fractions. 

First arrange in non-increasing order of value/weight : 


Item ID Weight Value/Weight 
10 10 1 























E 

B 50 35 0.7 
F 10 6 0.6 
C 40 20 0.5 
A 100 40 0.4 
D 20 4 0.2 














According to 0/1-knapsack problem, either we select an item or reject. So the 
item will be selected according to value per weight. 


Eis selected W=10<100 

Bis selected W=10+50 
= 60 < 100 

Fis selected W=60+10 
= 70< 100 


C cannot be selected because 
W = 70+ 40 = 110 > 100 
Hence we select D 
W = 70+ 20 = 90 < 100 
Total value = 10+ 35+6+4=55 
According to fractional knapsack problem, we can select fraction of any item. 
Eis selected W=10<100 


Bis selected W=10+50 

= 60 < 100 
Fis selected W=60+10 

= 70 < 100 
If we select C W= 70+ 40 

= 110>100 


Hence we select the fraction of item C as 

100-W 100-70 

WeightofC ~ 40 
Weight of C = 30/40 = 0.75 
So, W = 0.75 x 40 = 30 
W = 70+ 30= 100 
Total value = 10 + 35 + 6 + 0.75 (20) 
= 10+35+6+15=66 
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Que 3.20. | Consider the weight and values of item listed below. 


Note that there is only one unit of each item. The task is to pick a 
subset of these items such that their total weight is no more than 
11 kgs and their total value is maximized. Moreover, no item may 
be split. The total value of items picked by an optimal algorithm is 
denoted by Vopt* A greedy algorithm sorts the items by their value- 
to-weight rations in descending order and packs them greedily, 
starting from the first item in the ordered list. The total value of 
items picked by the greedy algorithm is denoted by V greedy" Find 


the value of Vit V greedy: 

















Total weight W= 11kg 
I, is picked so W= 11-2=9kg 
I, cannot picked 10 > 9 
I, is picked, W= 9-4=5kg 
I, cannot be picked 7 > 5 
I, and I, are picked so 
Voweeay = VU) + Vig) = 24 + 20 = 44 


greedy 
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For Vopt : For calculating Vit we use 0/1 knapsack problem, so only item 1 is 
picked. Hence, Vopt = 60 
So, VV 


opt greedy 


= 60-44=16 


Que 3.21. | Consider following instance for simple knapsack 


problem. Find the solution using greedy method. 
N=8 

P ={11, 21, 31, 33, 43, 53, 55, 65} 

W =(1, 11, 21, 23, 33, 43, 45, 55} 


M=110 AKTU 2016-17, Marks 7.5 


{1, 11, 21, 23, 33, 43, 45, 55} 

= {11, 21, 31, 33, 48, 53, 55, 65} 

M=110 

Now, arrange the value of P, in decreasing order 


1 1 11 11 

2 11 21 231 
3 21 31 651 
4 23 33 759 
5 33 43 1419 
6 43 53 2279 
7 45 55 2475 
8 55 65 3575 




















Now, fill the knapsack according to decreasing value of P,. First we choose 
item N = 1 whose weight is 1. 

Then choose item N = 2 whose weight is 11. 

Then choose item N = 3 whose weight is 21. 

Now, choose item N = 4 whose weight is 23. 

Then choose item N = 5 whose weight is 33. 

Total weight in knapsack is = 1+ 11+ 21+ 23 + 33 = 89 

Now, the next item is N =6 and its weight is 43, but we want only 21 because 
M=110. 

So, we choose fractional part of it, i.e., 

The value of fractional part of N = 6 is, 


2279 91 = 1113 
43 
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Thus, the maximum value is, 
= 11+ 231+ 651+ 759 + 1419 + 1113 
= 4184 
Que 3.22. | Solve the following 0/1-knapsack problem using dynamic 
programming P = {11, 21, 31, 33} w = {2, 11, 22, 15} c = 40,n =4. 


AKTU 2019-20, Marks 07 
Answer | 











Numerical : 
w = {2, 11, 22, 15} 
c= 40 
p = (11, 21, 31, 33) 
Initially, 
1, 2 1 
| L, | 11 | 21 | 
| | 22 | 31 | 
| i | 15 | 33 | 

















Now, arrange the value of p, in decreasing order. 
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Now, fill the knapsack according to decreasing value of p,. 

First we choose item I, whose weight is 22, then choose item I, whose 
weight is 15. Now the total weight in knapsack is 22 + 15 = 37. Now, next 
item is J, and its weight is 11 and then again I,. So, we choose fractional 
part of it, i.e., 


The value of fractional part of J, is, 
232 


= qq ee 


Thus, the maximum value is, 
= 682 + 495 + 63 = 1190 


PART-4 


Minimum Spanning Trees-Prim’s and Kruskal’s Algorithm, Single. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 





Que 3.23. | What do you mean by spanning tree and minimum 


spanning tree ? 


Answer 


! 


Spanning tree : 

1. Aspanning tree of a graph is a subgraph that contains all the vertices 
and is a tree. 

2. Aspanning tree ofa connected graph G contains all the vertices and has 
the edges which connect all the vertices. So, the number of edges will be 
1 less the number of nodes. 
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3. Ifgraphis not connected, i.e., a graph with n vertices has edges less than 
n—1then no spanning tree is possible. 


4. Agraph may have many spanning trees. 
Minimum spanning tree: 


1. Given a connected weighted graph G, it is often desired to create a 
spanning tree T for G such that the sum of the weights of the tree edges 
in T is as small as possible. 


2. Such a tree is called a minimum spanning tree and represents the 
“cheapest” way of connecting all the nodes in G. 
3. There are number of techniques for creating a minimum spanning tree 


for a weighted graph but the most famous methods are Prim’s and 
Kruskal’s algorithm. 


Que 3.24. | Write Kruskal’s algorithm to find minimum spanning 
tree. 


Answer | 


i. In this algorithm, we choose an edge of G which has smallest weight 
among the edges of G which are not loops. 


Bp: 


This algorithm gives an acyclic subgraph T of G and the theorem given 

below proves that T is minimal spanning tree of G. Following steps are 

required : 

Step1: Choose e,, an edge of G, such that weight ofe,, w(e,) is as small 
as possible and e, is not a loop. 


Step 2: IRPfedgese,,e., ......... , €;, have been selected then choose an edge 
e;,, not already chosen such that 


i. the induced subgraph 
Glfe, ..... e;,,}] is acyclic and 
i. w/(e,,,) is as small as possible 


Step 3: IfG has n vertices, stop after n — 1 edges have been chosen. 
Otherwise repeat step 2. 
If G be a weighted connected graph in which the weight of the edges are all 
non-negative numbers, let T be a subgraph of G obtained by Kruskal’s 
algorithm then, Tis minimal spanning tree. 


Que 3.25. | Describe and compare following algorithms to 


determine the minimum cost spanning tree : 
i. Kruskal’s algorithm 
ii. Prim’s algorithm 

OR 
Define spanning tree. Write Kruskal’s algorithm or finding minimum 
cost spanning tree. Describe how Kruskal’s algorithm is different 
from Prim’s algorithm for finding minimum cost spanning tree. 


AKTU 2019-20, Marks 07 
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Answer | 


Spanning tree : Refer Q. 3.23, Page 3-23B, Unit-3. 
i. Kruskal’s algorithm : Refer Q. 3.24, Page 3-24B, Unit-3. 
ii. Prim’s algorithm : 





First it chooses a vertex and then chooses an edge with smallest weight 
incident on that vertex. The algorithm involves following steps : 


Step 1: Choose any vertex V, of G. 

Step 2: Choose an edge e, =V,V, of G such that V, # V, and e, has 
smallest weight among the edge e of G incident with V,. 

Step 3 :If ane oe Cog vessees , é; have been chosen involving end points 


12 Wop cseeseesseees V,,1, choose an edgee,.= VV, with V,= {V,....... Vi 
and V, € {Vy ..scceee V.,,} such that e._, has smallest weight among the 


i+1 i+1 
edges rot G with precisely one end in {V,............... Vi 


Step 4:Stop after n — 1 edges have been chosen. Otherwise goto 
step 3. 


Comparison : 


S. No. Kruskal’s algorithm Prim’s algorithm 


1. Kruskal’s algorithm | Prim’s algorithm initializes with a 
initiates with an edge. node. 





2. Kruskal’s algorithm selects | Prim’s algorithms span from one 
the edges in a way that the | node to another. 

position of the edge is not 
based on the last step. 




















3. Kruskal’s can be used on| In Prim’s algorithm, graph must be 
disconnected graphs. a connected graph. 
4. Kruskal’s time complexity|Prim’s algorithm has a time 
in worst case is O(F log EZ). |complexity in worst case of 
O(E log V). 





Que 3.26. | What do you mean by minimum spanning tree ? Write 


an algorithm for minimum spanning tree that may generate 
multiple forest trees and also explain with suitable example. 


Answer 


| 


Minimum spanning tree : Refer Q. 3.23, Page 3-23B, Unit-3. 

Prim’s algorithm : Refer Q. 3.25, Page 3-24B, Unit-3. 

For example: 

According to algorithm we choose vertex A from the set {A, B, C, D, E, F, G, 
H, I, J}. 
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2 


3 
Now edge with smallest weight incident on A ise = AD 





Now we look on weight 


WA, B)=4 
WD, B)=4 WD, H)=5 
WD, J) =6 


We choose e = AB, since it is minimum. 
W(D, B) can also be chosen because it has same value. 


Again, 





WB, C)=4 
W(B, J) = 10 
W(D, H)=5 
WD, J) =6 


We choose e = BC, since it has minimum value. 
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Now, WB, J) = 10 
W(C, E) = 2 
WC, F)=1 


We choose e = CF, since it has minimum value. 





Now, WC, E) = 2 
WF, G)=3 
WF, D=5 


We choose e = CE, since it has minimum value. 





WE, G) = 2 
WF, G) = 3 
WF, D=5 


We choose e = EG, since it has minimum value. 
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WG, J) =4 
WG, D=3 
WF, D=5 


We choose e = GI, since it has minimum value. 





WT, J) =3 
WG, J) =4 
We choose e = IJ, since it has minimum value. 
WJ, H) = 2 
Hence, e = JH will be chosen. 


The final minimal spanning tree is given as : 


Fig. 3.26.1. 
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Que 3.27. | What is minimum cost spanning tree ? Explain Kruskal’s 
algorithm and find MST of the graph. Also write its time complexity. 








AKTU 2017-18, Marks 10 
Answer | 


Minimum spanning tree: Refer Q. 3.23, Page 3-23B, Unit-3. 
Kruskal’s algorithm : Refer Q. 3.24, Page 3-24B, Unit-3. 


Numerical : 
Step 1: Arrange the edge of graph according to weight in ascending order. 


Weigh Weigh 
13 2 32 6 





























Step 2 : Now draw the vertices as given in graph, 


@ 
So) ® 
@) 
© © 


Now draw the edge according to the ascending order of weight. If any edge 
forms cycle, leave that edge. 
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Step 3: Select edge 13 


Cane, 


© © 


Step 4: Select edge 46 


Oa 
ee) 


Step 5: Select edge 25 


G-oa © © © © 


Ou-n ©) 
Oz 


Step 6: Select edge 36 


@) 
. 
©) 


Step 7: Select edge 23 





All the remaining edges, such as 34, 41, 12, 35, 56 are rejected because they 
form cycle. 

All the vertices are covered in this tree. So, the final tree with minimum cost 
of given graph is 
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Minimum cost = 2+3+4+5+6=20 
Time complexity : Time complexity is O(|E | log ||). 


Que 3.28. | What is minimum spanning tree ? Explain Prim’s 
algorithm and find MST of graph Fig. 3.28.1. 
6 





AKTU 2015-16, Marks 05 
Answer | 


Minimum spanning tree : Refer Q. 3.23, Page 3-23B, Unit-3. 
Prim’s algorithm : Refer Q. 3.25, Page 3-24B, Unit-3. 
Numerical : 





Fig. 3.28.2. 


Let a be the source node. Select edge (a, b) as distance between edge (a, b) 


is minimum. 
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Now, select edge (b, c) 


Now, select edge (c, i) 


Now, select edge (i, g) 


Now, select edge (g, h) 


Now, select edge (g, f) 
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Now, select edge (e, d) 





Thus, we obtained MST for Fig. 3.28.1. 


PART-5 


Source Shortest Paths-Dijkstra’s and Bellman-Ford Algorithm. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 


Que 3.29. | Prove that the weights on the edge of the connected 


undirected graph are distinct then there is a unique minimum 
spanning tree. Give an example in this regard. Also discuss prim’s 
minimum spanning tree algorithm in detail. 


AKTU 2018-19, Marks 07 
Answer | 


Proof : 


1. Let we have an algorithm that finds an MST (which we will call A) based 
on the structure of the graph and the order of the edges when ordered 
by weight. 





Assume MST A is not unique. 

There is another spanning tree with equal weight, say MST B. 
Let e1 be an edge that is in A but not in B. 

Then, B should include at least one edge e2 that is not in A. 
Assume the weight of e1 is less than that of e2. 

As B isa MST, {e1} UB must contain a cycle. 


arora rF wD 


Replace e2 with e1 in B yields the spanning tree {e1} U B — {e2} which has 
a smaller weight compared to B. 


9. This contradicts that Bis not a MST. 
So, MST of undirected graph with distinct edge is unique. 
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Example: 























Fig. 3.29.1. 

Step 1: Arrange the edge of graph according to weight in ascending 
order. 

12 1 14 7 

13 2 35 8 

46 3 

25 4 

36 5 

56 6 

















© © 


Now draw the edge according to the ascending order of weight. If any 
edge forms cycle, leave that edge. 


a @ 


© © 
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Step 4: 
1 
2 @® 
@) () 
Step 5: 
1 
= @ 
3 
@) ©) 
Step6: 
LAY 
@  @ 
4) @ fs 
G) (6) 
Step 7: 





All the remaining edges, such as: 14, 35, 56 are rejected because they 
form cycle. 

All the vertices are covered in this tree. So, the final tree with minimum 
cost of given graph is 





Prim’s algorithm : Refer Q. 3.25, Page 3-24B, Unit-3. 
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Que 3.30. | Write an algorithm to find shortest path between all 


pairs of nodes in a given graph. 
OR 
Explain greedy single source shortest path algorithm with example. 


AKTU 2015-16, Marks 10 
OR 


Write short note on Dijkstra’s algorithm shortest paths problems. 


AKTU 2016-17, Marks 10 
Answer | 


1. Dijkstra’s algorithm, is a greedy algorithm that solves the single source 
shortest path problem for a directed graph G = (V, E) with non-negative 
edge weights, i.e., we assume that w(u, v) > 0 each edge (u, v) € E. 


2.  Dijkstra’s algorithm maintains a set S of vertices whose final shortest 
path weights from the source s have already been determined. 


3. That is, for all vertices v <¢ S, we have d[v] = Os, v). 


The algorithm repeatedly selects the vertex u « V—S with the minimum 
shortest path estimate, inserts u into S, and relaxes all edges leaving u. 


5. We maintain a priority queue Q that contains all the vertices in 
v —S, keyed by their d values. 


6. Graph Gis represented by adjacency list. 


7. Dijkstra’s always chooses the “lightest or “closest” vertex in V—S to 
insert into set S that it uses as a greedy strategy. 


Dijkstra’s algorithm : 


DIJKSTRA (G, w, s) 

1. INITIALIZE-SINGLE-SOURCE (G, s) 
2. seo 

3. Q<VIG) 

4. whileQ+¥o 

5. do u< EXTRACT-MIN (Q) 

6. S<¢Svu{u} 

ts for each vertex v € Adj [u] 
8. do RELAX (u, v, w) 
RELAX (u, v, w): 

1. Ifd[u] + w(u, v) < dv] 

2. then d[v] < d[u] + w(u, v) 


3. tv] <u 
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Que 3.31. | Find the shortest path in the below graph from the 


source vertex 1 to all other vertices by using Dijkstra’s algorithm. 


(2) 





Answer | 


Initialize : 
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Extract min(2): 


S: {1, 2} 
3 4 5 
ce cO co 


co co co 
60 30 100 
60 30 100 


{1, 2, 4} 

3. 44 5 
0 840 ~~) 00 
60 30 100 





S:: {12,4} 
3 4 5 
coc coc oc 
60 30 100 
60 100 
50 
100 ad 30 
Extract min(3): 

: {1, 2, 4, 3} 
3 4 5 
[o@) co co 
co 380 100 


60 [30] 100 


50 
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All edges leaving (3) : 


Q 


~) 


‘a S:{1, 2, 4,3,} 
359 Q:1 2 3 4 «5 


[o] « me om aa 


co 380 100 


60 100 
60 





CO CO co co 


[10] «o 30 100 


60 100 


ue 3.32. |State Bellman-Ford algorithm. 


gee? 


AKTU 2016-17, Marks 7.5 


swer | 


Bellman-Ford algorithm finds all shortest path length from a source 
s e Vtoallv e Vor determines that a negative-weight cycle exists. 


Bellman-Ford algorithm solves the single source shortest path problem 
in the general case in which edges of a given digraph G can have 
negative weight as long as G contains no negative cycles. 

This algorithm, uses the notation of edge relaxation but does not use 
with greedy method. 

The algorithm returns boolean TRUE if the given digraph contains no 
negative cycles that are reachable from source vertex otherwise it 
returns boolean FALSE. 
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Bellman-Ford (G, w, s): 
1. INITIALIZE-SINGLE-SOURCE (G, s) 

2. for each vertex i < 1 to VIG]-1 

3 do for each edge (u, v) in E[G] 

4, do RELAX (u, v, w) 

5. for each edge (u, v) in E[G] do 

6 do if d[u] + w(u, v) < d[v] then 

7 then return FALSE 

8. return TRUE 

RELAX (u, v, w): 

1. Ifd[u] + w(u, v) < dv] 

2. then d[v] < d[u] + w(u, v) 

3. alo) <u 

If Bellman-Ford returns true, then G forms a shortest path tree, else there 
exists a negative weight cycle. 

Que 3.33. | When do Dijkstra and the Bellman Ford algorithm 


both fail to find a shortest path ? Can Bellman Ford detect all 
negative weight cycles in a graph ? Apply Bellman Ford algorithm 
on the following graph : 
Source 
vertex 





Fig. 3.33.1. 


AKTU 2018-19, Marks 07 


Answer | 


Dijkstra algorithm fails to find a shortest path when the graph contains 
negative edges. 


Bellman Ford algorithm fails to find a shortest path when the graph contain 
negative weight cycle. 


No, Bellman Ford cannot detect all negative weight cycle in a graph. 
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a 


ia 


st 


ie, 
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VERY IMPORTANT QUESTIONS 


Following questions are very important. These questions 
may be asked in your SESSIONALS as well as 


UNIVERSITY EXAMINATION. 





Ans. 


. Discuss matrix chain multiplication problem and its solution. 
: Refer Q. 3.2. 


. Explain graphs with its representations. 
: Refer Q. 3.4. 


. Write short note on convex null problem. 
: Refer Q. 3.9. 


. What is greedy algorithm ? Write its pseudocode for 


recursive and iterative process. 


: Refer Q. 3.14. 


. Discuss 0/1-knapsack problem. 
: Refer Q. 3.18. 


. Write short note on the following : 


Minimum spanning tree 
Kruskal’s algorithm 
Prim’s algorithm 


Refer Q. 3.23. 
Refer Q. 3.24. 
Refer Q. 3.25. 


. Write an algorithm to find shortest path between all pairs 


of nodes in a given graph. 


j Refer Q. 3.30. 


. State Bellman Ford algorithm. 
: Refer Q. 3.32. 


. Solve the following 0/1-knapsack problem using dynamic 


programming P = {11, 21, 31, 33} w = {2, 11, 22, 15} c = 40, 
n=A4, 
Refer Q. 3.22. 


OOO 
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PART- 1 


Dynamic Programming with Examples such as Knapsack. 











Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 4.1. | What do you mean by dynamic programming ? 


OR 
What is dynamic programming ? How is this approach different 
from recursion? Explain with example. 


AKTU 2019-20, Marks 07 
Answer | 


1. Dynamic programming is a stage-wise search method suitable for 
optimization problems whose solutions may be viewed as the result of a 
sequence of decisions. 

2. Itis used when the sub-problems are not independent. 

3. Dynamic programming takes advantage of the duplication and arranges 
to solve each sub-problem only once, saving the solution (in table or 
something) for later use. 


4. Dynamic programming can be thought of as being the reverse of 
recursion. Recursion is a top-down mechanism i.e., we take a problem, 
split it up, and solve the smaller problems that are created. Dynamic 
programming is a bottom-up mechanism 1.e., we solve all possible small 
problems and then combine them to obtain solutions for bigger problems. 
Difference : 

1. In recursion, sub-problems are solved multiple times but in dynamic 
programming sub-problems are solved only one time. 

2. Recursion is slower than dynamic programming. 

For example : 
Consider the example of calculating n“* Fibonacci number. 
fibo(n) = fibo(n — 1) + fibo(n — 2) 
fibo(n — 1) = fibo(n — 2) + fibo(n — 3) 
fibo(n — 2) = fibo(n — 3) + fibo(n — 4) 


fibo(2) = fibo(1) + fibo(0) 
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In the first three steps, it can be clearly seen that fibo(n —3) is calculated 
twice. If we use recursion, we calculate the same sub-problems again 
and again but with dynamic programming we calculate the sub-problems 
only once. 


Que 4.2. | What is the principle of optimality ? Also give approaches 


in dynamic programming. 


Answer | 


Principle of optimality : Principle of optimality states that whatever the 
initial state is, remaining decisions must be optimal with regard the state 
following from the first decision. 


Approaches in dynamic programming : 
There are two approaches of solving dynamic programming problems : 


1. Bottom-up approach : Bottom-up approach simply means storing the 
results of certain calculations, which are then re-used later because the 
same calculation is a sub-problem in a larger calculation. 


2. Top-down approach : Top-down approach involves formulating a 
complex calculation as a recursive series of simpler calculations. 


Que 4.3. | Discuss the elements of dynamic programming. 


Answer | 


Following are the elements of dynamic programming : 


1. Optimal sub-structure : Optimal sub-structure holds if optimal solution 
contains optimal solutions to sub-problems. It is often easy to show the 
optimal sub-problem property as follows : 


i. Split problem into sub-problems. 


ii. Sub-problems must be optimal; otherwise the optimal splitting would 
not have been optimal. 


There is usually a suitable “space” of sub-problems. Some spaces are 
more “natural” than others. For matrix chain multiply we choose sub- 
problems as sub-chains. 


2. Overlapping sub-problem : 


i. Overlapping sub-problem is found in those problems where bigger 
problems share the same smaller problems. This means, while 
solving larger problems through their sub-problems we find the 
same sub-problems more than once. In these cases a sub-problem 
is usually found to be solved previously. 


iii Overlapping sub-problems can be found in Matrix Chain 
Multiplication (MCM) problem. 
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1.4 
OK SS 


3.38 4.4 2.2 3.3 2.2 3.3 1.1 2.2 
Fig. 4.3.1. The recursion tree for the computation 
of Recursive-Matrix-Chain (p, 1, 4). 

Memoization : 

i. The memoization technique is the method of storing values of 
solutions to previously solved problems. 

ii. This generally means storing the values in a data structure that 
helps us reach them efficiently when the same problems occur 
during the program’s execution. 

iii. The data structure can be anything that helps us do that but 
generally a table is used. 


Que 4.4. | Write down an algorithm to compute Longest Common 


Subsequence (LCS) of two given strings and analyze its time 


complexity. AKTU 2017-18, Marks 10 


An 


swer 


| 


LCS-Length (X, Y): 


WOANoOaAarPwWwnre 


m < length[X] 

n < length[Y] 

fori<-_ltom 

do cli, 0] < 0 

forj<Oton 

do c[0, 7] < 0 

fori<_ltom 

do forj<lton 

do ifx, =y, 

then cli, j] < cli-1,j-1] +1 


. bi he 


else if cli- 1, j] >cli, j- 1] 


. thencli, J] <—cli-1, J] 


bli, jl“? 
else cli, j] < cli, j- 1] 
bli, j] “” 
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17. returnc and b 
Note: 


1. “\» means both the same. 

2. “Tt? means cli - 1, j] >cli, j- 11. 

3. “e” means cli-1, j] < cli, j- 11. 

4. The “\” diagonal arrows lengthen the LCS. 


Since, two for loops are present in LCS algorithm first for loop runs upto m 
times and second for loop runs upto n times. So, time complexity of LCS is 
O(mn). 


Que 4.5. | Give the algorithm of dynamic 0/1-knapsack problem. 


Answer | 


Dynamic 0/1-knapsack(v, w, n, W): 


1. for (w =0 to W) VIO, w] =0 

2. for(i =1ton) 

3 for (w = 0 to W) 

4, if (w[i] < w) then 

5 Vii, w] = max{V[i - 1, w], vii] + Vii — 1, w — wii}; 
6 else V[i, w] = Vii — 1, w]; 


7. return V[n, WI; 


Now, as we know that V [n, W] is the total value of selected items, the can 
be placed in the knapsack. Following steps are used repeatedly to select 
actual knapsack item. 


Let, i=n and k= Wthen 
while (1 > 0 and k > 0) 
{ 
if (Vii, k] # Vii — 1, k]) then 
mark i‘ item as in knapsack 
i=i-landk=k-w,// selection of i* item 
else 
i=i-1 //donot select i“ item 


} 


Que 4.6. | Differentiate between dynamic programming and greedy 


approach. What is 0/1 knapsack problem ? Solve the following 
instance using dynamic programming. Write the algorithm also. 
Knapsack Capacity = 10, P = <1, 6, 18, 22, 28 > and w = < 1, 2, 5, 6, 7>. 
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Answer | 

















S. No. Dynamic programming Greedy approach 

1. Solves every optimal sub- | Do not solve every optimal 
problem. problem. 

2. We make achoice at each step, | We make whatever choice 
but the choice may depend on | seems best at the moment and 
the solutions to sub-problem. | then solve the problem. 

3. It is bottom-up approach. It is top-down approach. 

4, Dynamic programming works | Greedy algorithm works when 
when a problem has following | a problem exhibits the following 
properties : properties : 

a. Optimal sub-structure a. Greedy choice property 
b. Overlapping sub-problems | b. Optimal sub-structure 





0/1-knapsack problem : Refer Q. 3.18, Page 3-17B, Unit-3. 
0/1-kanpsack algorithm : Refer Q. 4.5, Page 4-5B, Unit-4. 


Numerical : 
Item Ww; p, =0,/w, (Given) U; 
Z, i 1 1 
Z, 2 6 12 
I, 5 18 90 
[, 6 22 132 
q 7 28 196 

















Now, fill the knapsack according to given value of p,. 
First we choose item J, whose weight is 1, then choose item J, whose 
weight is 2 and item J, whose weight is 5. 


Total weight in knapsack: 1+2+5=8 


Now, the next item is J, and its weight is 6, but we want only 2 
{-.: W = 10}. So we choose fractional part of it i.e., 
The value of fractional part of I, is = 1382/6 x 2 = 44 
Thus the maximum value is = 1+ 12 + 90 + 44 = 147 


Rb] o1 


| 5 tl ag 
| 2 
| 1 | 











Que 4.7. | Discuss knapsack problem with respect to dynamic 


programming approach. Find the optimal solution for given 
problem, w (weight set) = {5, 10, 15, 20} and W (Knapsack size) = 25 


and v = {50, 60, 120, 100}. AKTU 2015-16, Marks 10 
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Answer | 


Knapsack problem with respect to dynamic programming 
approach : Refer Q. 4.5, Page 4-5B, Unit-4. 

















Numerical : 
w = {5, 10, 15, 20} 
W = 25 
v = {50, 60, 120, 100} 
Initially, 
Item Ww; v; 
I, 5 50 
L, 10 60 
I, 15 120 
[, 20 100 














Taking value per weight ratio, i.e., p, = v,/w; 











Item Ww; U; p,=0/u; 
[, 5 50 10 
I, 10 60 6 
I, 15 120 8 
I, 20 100 5 





























Item Ww; U; p, =v; 
I, 5 50 10 
I, 15 120 8 
L, 10 60 6 
I, 20 100 5 








Now, fill the knapsack according to decreasing value of p,. 

First we choose item J, whose weight is 5, then choose item J, whose 
weight is 15. Now the total weight in knapsack is 5 + 15 = 20. Now, next 
item is J, and its weight is 10, but we want only 5. So, we choose fractional 
part of it, i.e., 
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25 





The value of fractional part of J, is, 


= By x 5= 30 
10 


Thus, the maximum value is, 
= 50+ 120+ 3 = 200 


Que 4.8. | Compare the various programming paradigms such as 
divide-and-conquer, dynamic programming and greedy approach. 


AKTU 2019-20, Marks 07 
Answer | 





S.No. Divide and Dynamic Greedy 
conquer programming approach 
approach approach 
1. Optimizes by|Same as Divide and| Optimizes by 


breaking down a/|Conquer, but optimizes | making the best 
subproblem into | by caching the answers | choice at the 
simpler versions of | to each subproblem as |} moment. 
itselfand using multi-|not to repeat the 

threading and | calculation twice. 

recursion to solve. 





2. Always finds the | Always finds the optimal |} Does not always 
optimal solution, but | solution, but cannot | find the optimal 
is slower  than/work onsmall datasets. | solution, but is 











Greedy. very fast. 

3. Requires some | Requires a lot of memory | Requires almost 
memory to | for tabulation. no memory. 
remember recursive 
calls. 








PART-2 


All Pair Shortest Paths : Warshall’s and Floyd’s Algorithm, 
Resource Allocation Problem. 
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Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 4.9. | Describe the Warshall’s and Floyd’s algorithm for 
finding all pairs shortest paths. 


Answer | 


1. Floyd-Warshall algorithm is a graph analysis algorithm for finding 
shortest paths in a weighted, directed graph. 


N 


A single execution of the algorithm will find the shortest path between 
all pairs of vertices. 


3. It does so in O(V?) time, where V is the number of vertices in the graph. 


> 


Negative-weight edges may be present, but we shall assume that there 
are no negative-weight cycles. 


5. The algorithm considers the “intermediate” vertices of a shortest path, 
where an intermediate vertex of a simple path p = (v,, v,, ..., v,,) is any 
vertex of p other than u, or v,,, that is, any vertex in the set {v,, v,, 
Uw 


m-1'* 


6. Let the vertices of G be V = {1, 2, ..., n}, and consider a subset {1, 2, ..., 
k} of vertices for some k. 


7. For any pair of vertices i, 7 <¢ V, consider all paths from i to 7 whose 
intermediate vertices are all drawn from {1, 2, ..., k}, and let p be a 
minimum-weight path from among them. 

8. Let ae be the weight of a shortest path from vertex i to vertex j with 
all intermediate vertices in the set {1, 2, ..., Rk}. 

A recursive definition is given by 

a W,; if k=0 

_ laden de? + de? )if k=1 

Floyd-Warshall (W) : 

n < rows [W] 

D© < WwW 

fork<1lton 
do fori<l1ton 

do forj<lton 


b . kl) y(k-1 (k-1) 
do ay < min(d; ‘ di yy d,; ) 


IP OP OWN 


return D” 
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Que 4.10. | Define Floyd Warshall algorithm for all pair shortest 
path and apply the same on following graph : 





AKTU 2019-20, Marks 07 
Answer | 


Floyd Warshall algorithm : Refer Q. 4.9, Page 4-9B, Unit-4. 
Numerical: 


d{ = min[d/* ol ees dy?) 


com me 1) if dit 1) < di- Dy di 1) 


Nij 
Ty 1) if di 1) >a eae 1) 








110° 6 3 ” 
2/3 0 2 © 
D = 
4/> 11 60 @ 
5[> 4 > 2 Q| 
12 3 45 
1fo4 6 00 
2/309 6° 
(= 
DY =316 40 2 2 

















Design and Analysis of Algorithms 4-11 B (CS/IT-Sem-5) 





4/4 1 1 0 °° 








5/6 3 38 2 0O 


Now, if we find D®’, D® and D® there will be no change in the entries. 


Que 4.11. | Give Floyd-Warshall algorithm to find the shortest 
path for all pairs of vertices in a graph. Give the complexity of the 


algorithm. Explain with example. AKTU 2018-19, Marks 07 
Answer | 


Floyd-Warshall algorithm : Refer Q. 4.9, Page 4-9B, Unit-4. 
Time complexity of Floyd-Warshall algorithm is O(n). 
Example: 





Fig. 4.11.1. 


a 
= 
i] 


: kV) 7(k-1 k-1 
= mind! aks +d | 


Li 


(k-1) ; (k-1) (k-1) (k-1) 
on if d?) <df? + df 


nD if de? > dk? 4a 


(0 8 8 wo —4) NIL 1 1 NIL 1 

o 0 1 7 NIL NIL NIL 2 2 
D®=|0 4 0 wo of|sn=|NIL 3 NIL NIL NIL 
20-5 0 4 NIL 4 NIL NIL 
0 00 6 0 NIL NIL NIL 5 NIL 
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(0 3 8 wo -4 [NIL 1 1 £NIL 1 
o 0 L F NIL NIL NIL 2. 2 
D»=|0 4 0 © ofse%=|NIL 3 NIL NIL NIL 
25-5 0 -2 4 1 4 NL 1 
oO 0 6 0 [NIL NIL NIL 5 NIL| 
(0 3 8 4 -4 NIL 1 1 2 1 7 
o 0 1 Ff NIL NIL NIL 2. 2 
D®=|o 4 O 5 11|;n?=/NIL 3 NIL 2. 2 
2 5 -5 0 =2 4 1 4 #=NIL 1 
oO 0 6 0 |NIL NIL NIL 5 NIL| 
G 2 6 tad [NIL 1 1 2 1 7 
o 0 ol 7 NIL NIL NIL 2. 2 
D®=|o0 4 O 5 11};nx®=|NIL 3 NIL 2 2 
2.4 25 6.2 4 38 #4 NIL 1 
0 0 0 6 0 [NIL NIL NIL 5 NIL| 
0 3 -1 4 -4) [NIL 1 4 2 1 7] 
3 0-41 -1 4 NIL 4 2 1 
D®=|7 4 05 3iyn%=|4 38 NIL2 1 
2-1-5 0 -2 4 3 4 NIL 1 
8 5 16 0 [4 38 4 5. NIL 
(Oo 1 <9 <4) NIL 3 4 5 1 
a @ ot 1 <7 4 NIL 4 2 1 
D®=|7 4 05 3\/s:n%=/4 38 NIL 2 1 
221 =% 028 4 3 4 NIL 1 
8 5 16 0 4 3 4 5 NIL 


PART-3 


Backtracking, Branch and Bound with Examples such as 
Travelling Salesman Problem. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 
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Que 4.12. | What is backtracking ? Write general iterative algorithm 
for backtracking. AKTU 2016-17, Marks 10 
Answer | 


1. Backtracking is a general algorithm for finding all solutions to some 
computational problems. 


2. Backtracking is an important tool for solving constraint satisfaction 
problems, such as crosswords, verbal arithmetic, and many other 
puzzles. 


3.  Itis often the most convenient (if not the most efficient) technique for 
parsing, for the knapsack problem and other combinational optimization 
problem. 


4. Itcanbe applied only for problems which admit the concept ofa “partial 
candidate solution” and a relatively quick test of whether it can possibly 
be completed to a valid solution. 


Iterative backtracking algorithm : 

algorithm ibacktrack (n) 

// Iterative backtracking process 

// All solutions are generated in x[1: n] and printed as soon as they are 


found 

{ 

k=1; 

while (k != 0) 

{ 

if ( there remains an untried x[k] in T(x[1], x[2], ..., x[ —1]) 


and B_R(x[1], ..., x[R] ) is true ) 

{ 

if (x[1], ..., x[2] is a path to an answer node ) 
write (x[1 : k]); 


k=k+1; // Consider the next set 

} 

else 

k=k-1; // Backtrack to the previous set 


} 
} 
Que 4.13. | Describe backtracking algorithm for Travelling 


Salesman Problem (TSP). Show that a TSP can be solved using 
backtracking method in the exponential time. 
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OR 


Explain TSP (Travelling Salesman) problem with example. Write 


an approach to solve TSP problem. AKTU 2015-16, Marks 10 
Answer | 


Travelling Salesman Problem (TSP) : 


Travelling salesman problem is the problem to find the shortest possible 
route for a given set of cities and distance between the pair of cities that 
visits every city exactly once and returns to the starting point. 


Backtracking approach is used to solve TSP problem. 
Backtracking algorithm for the TSP : 
1. Let Gbe the given complete graph with positive weights on its edges. 


2. Use a search tree that generates all permutations of V = {1 ... n}, 
specifically the one illustrated in Fig. 4.13.1 for the case n = 3. 





Fig. 4.13.1. 


3. A node at depth i of this tree (the root is at depth 0) stores an 
i-permutation of {1, ...,n}. A leaf stores a permutation of {1, ..., n}, which 


is equivalent to saying that it stores a particular Hamiltonian cycle (tour) 
of G. 


4. For the travelling salesman problem, we will not do any static pruning 
on this tree, we will do dynamic pruning, during the search. 


Proof: 


1. Atsome point during the search, let v be anon-leaf node of this tree that 
is just being visited, and let w be the weight of the shortest tour found to 
this point. 


2. Let (n,7... ,) be the k-permutation of {1 ... n} stored at v. 
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Let, w, = » W,,n,,, denote the sum of the weights on edges whose 
isl....k=1 
endpoints are adjacent vertices in this k-permutation. 
3. Then, if w, > w, the entire subtree of the search tree rooted at v can be 


pruned, i.e., not searched at all, since every leaf of this subtree 
represents a tour whose weight must be greater than w,. 


4. This follows from the fact that all edges in the graph have positive 


weights. 

5. There are atmost O(n*2”") subproblem, and each one takes linear time 
to solve. 
The total running time is therefore O(n?*2"). 

7. The time complexity is much less than O(n!) but still exponential. 


Hence proved. 


Que 4.14. | Explain the working rule for Travelling Salesman 


Problem using branch and bound technique. 


Answer | 


For solving travelling salesman problem we represent the solution space 
by a state space tree. We define three cost functions C, / and u where 
1, < C; <u, for all the nodes of the state space tree. 


Step 1: First find the cost matrix as given cost on the edges of the graph. 


Step 2 : Now, find reduced matrix by subtracting the smallest element 
from row i (column j) introduce a zero in to row i (column j). Repeating 
this process as often as needed, the cost matrix can be reduced. 

Add the total amount subtracted from the column and rows and make this 
as the root of the state space tree. 


Step 3: Let M be the reduced cost matrix for node A and let B be achild of 
A such that the tree edge (A, B) corresponds to inclusion of edge (i,j) in the 
tour. If B is not a leaf, then the reduced cost matrix for B may be obtained 
by apply following given steps : 


a. Change all the entries in row i, column of M to . This includes 
use of any more edges leaving vertex i or entering vertex j. 


b. Set MG, 1) =~. This excludes use of the edge (j, 1). 


c. Reduce all the rows and columns in the resulting matrix except 
for rows and columns containing only ~. 


Suppose T is the total amount subtracted in step (c), then 
I(B) = (A) + Mi, j)+T 
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For leaf nodes / =c is easily computed as each leaf defines a unique tour. 
For the upper bound u, we assume u, = ~ for all nodes 7. 


Step 4: Find the root of the node as, combine the total amount subtracted 
from cost matrix to find the reduced cost matrix M. 


Que 4.15. | What is travelling salesman problem ? Find the solution 


of following travelling salesman problem using branch and bound 


method. 


Cost matrix = 


Answer | 


Travelling salesman problem 
Numerical : 


Cost matrix = 


16 


20 


mw Oo 8 


30 10 11 
164 2 
o 2 4 
6 3 
7 16 


AKTU 2016-17, Marks 10 


: Refer Q. 4.13, Page 4-13B, Unit-4. 


10 11 
4 2 
2 4 
wo 8 
16 


1. Reduce each column and row by reducing the minimum value from 
each element in row and column. 














Column 

1 3 

v v 7 

* 10 17 0 1 

12 *° 11 2 O 

0 38 * 0 2 =M, 
15 3 0 7 0 

11 0 012 % 








So, total expected cost is:10+2+24+34+44+1+3=25. 
We have discovered the root node V, so the next node to be expanded 


will be V,, V;, V,, V;. Obtain cost of expanding using cost matrix for node 


Row 
10 ~/[~ 19 20 0 1 
2—~/13 © 14 2 0 
2—~/1 3 ° 0 2 
S-|té¢ 2 42 © 
4/12 0 3 12 % 
2. 
a, 
2. 
4, 


Change all the elements in 1%* row and 2"4 column. 
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11 
ioe) 
0 
11 © O 12 


oO 
(oe) 
(oe) 
(oe) 


8 ow 8 


5. Now, reducing M, in rows and columns, we get : 


co co co 


12 © 11 2 
M,=| 0 © © O 
15 © 0 
11 © O 12 


Total cost for M, = 25 +10+0=35 
6. Similarly, for node 3, we have : 


sS 

TT 

—) 
own 8 8 


8 8 8 8 8 


11 
7. Now, reducing M,, we get: 


ee 





— 

TT 

(=) 
oww 8 8 


8 8 8 8 8 


.. Total cost for M, = 25 + 17+ 0 = 42 
8. Similarly, for node 4, we have : 


ioe) ioe) ioe) oe) 

12 © 11 @ 

M, = 0 3 w w 
15 3 0 

{11 0 0 

9. Now, reducing M,, we get : 

[ oe) ioe) co oe) 

12 © 11 © 

M,=| 0 3 © 
15 3 0 

11 0 O w 





ono 8 


oO 
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.. Total cost = 25+0+0=25 
10. Similarly, for node 5, we have : 





[ co 0 ie,0) 

12 o 11 

Mz=| 0 3 
15 3 O 

[11 0 O 

11. Now, reducing M,, we get: 

[ co co 

10 wo 9 

Ms=| 0 3 © 
15 38 0 

11 0 0 


8 8 8 8 8 


8 8 8 8 8 





Fig. 4.15.1. 


12. Now, the promising node is V, = 25. Now, we can expand V,, V, and V;. 


Now, the input matrix will be M,. 


13. Change all the elements in 4" row and 2"4 column. 


[ co 6c co 

12 o 11 

M, =| 0 0 
co. 080 0O 

[11 © 0O 

14. On reducing M,, we get : 

[ co. 6080 co 

12 o 11 

M,=| 0 2 
co co ioe) 

[11 © 0O 





8 8 8 8 8 


8 8 8 8 8 
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.. Total cost = 25+3+4+0= 28 
15. Similarly, for node 3, we have : 








i ioe) co co oe) 00 | 
12 0 0 wo O 
M,=|0 3 © © 2 
on 8 0 wo 0 
[11 0 «© © | 
16. On reducing M,, we get : 
[ ioe) co co co 00 | 
12 0 0 wo O 
M,= 0 3 0 wo 2 
on 8 ow 0 
[11 0 «© © | 
.. Total cost = 25+0+0=25 
17. Similarly, for node 5, we have : 
[ co co co co co 
12 © 11 © @ 
M,=| 0 3 © © ow 
oO oe) ioe) oO ioe) 
[11 0 0 2 
18. On reducing M,, we get : 
[ oe) co ioe) oe) ioe) 
10 00 o 
M,=| 0 3 © © 
co oe) oe) co oe) 
11 0 0 @© ow 


.. Total cost = 25+0+11=36 


V,=28 V3=25 V;=36 
Fig. 4.15.2. 


19. Now, promising node is V, = 25. Now, we can expand V, and V;. Now, 
the input matrix will be M,. 
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20. Change all the elements in 3™ row and 2"4 column. 


co 0 «0 0 OO 
12 © 0 wo O 
My =|c 0 © © oO 
co 0 © o 0 
[11 2 2% © 
21. On reducing Mg, we get : 
[co 0 «© «© 
10 woo 0 
My =/]0 © © © 
0c 0 © o 0 
0 0 © 0 


.. Total cost = 25 + 3 + 0 = 28 
22. Similarly, for node 5, we have : 





00 00 0 0 OO 
12 © © © 
Mi 00 0 0 OOO 
co 88 © «© © 
[11 0 «© © ow} 
23. On reducing M,,, we get : 
[0 0 0 © ow| 
0 0 © 0 
Mi 0 0 0 © © 
co 0 © «© 
11 0 © © o| 





.. Total cost = 25+2+ 12 +3= 42. 


< 
i) 
BOECtCae 
bo 

° ie.) 
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24, Here V, is the most promising node so next we are going to expand this 
node further. Now, we are left with only one node not yet traversed 
which is V;. 





10. 6 5 2. 16 
V, > V, > V3 > V2 > V; > Vi, 
So, total cost of traversing the graph is : 


10+6+54+2+16=39 
PART-4 


Graph Colouring, N-Queen Problem. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 4.16. | Write short notes on graph colouring. 


Answer | 


1. Graph colouring is a simple way of labelling graph components such as 
vertices, edges, and regions under some constraints. 


N 


In a graph, no two adjacent vertices, adjacent edges, or adjacent regions 
are coloured with minimum number of colours. This number is called 
the chromatic number and the graph is called a properly coloured 
graph. 

3. While graph colouring, the constraints that are set on the graph are 
colours, order of colouring, the way of assigning colour, etc. 


4. Acolouring is given to a vertex or a particular region. Thus, the vertices 
or regions having same colours form independent sets. 


For example : 
Blue 


Yellow Red 


Blue Yellow 
Fig. 4.16.1. Properly coloured graph. 


Que 4.17. | Write short notes on N-Queens problem. 
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OR 
Write pseudocode for 8-Queens problem. 


AKTU 2016-17, Marks 10 
Answer | 


1. In N-Queens problem, the idea is to place queens one by one in different 
columns, starting from the leftmost column. 


2. When we place a queen in a column, we check for clashes with already 
placed queens. 


3. Inthe current column, if we find a row for which there is no clash, we 
mark this row and column as part of the solution. 


4. If we do not find such a row due to clashes then we backtrack and 
return false. 


Procedure for solving N-Queens problem : 

1. Start from the leftmost column. 

2.  Ifall queens are placed return true. 

3. Try all rows in the current column. Do following for every tried row : 


a. Ifthe queen can be placed safely in this row then mark this [row, 
column] as part of the solution and recursively check if placing 
queen here leads to a solution. 


b. If placing queen in [row, column] leads to a solution then return 
true. 


c. Ifplacing queen does not lead to a solution then unmark this [row, 
column] (backtrack) and go to step (a) to try other rows. 


4.  Ifall rows have been tried and nothing worked, return false to trigger 
backtracking. 


Algorithm/pseudocode for N-Queens problem : 


N-Queens are to be placed on ann x n chessboard so that no two attack i.e., 
no two Queens are on the same row, column or diagonal. 


PLACE (k, i) 

1. forj<1tok-1 

2. do if (xj) = 7) or Abs (x[j] — 7) = (Abs ( — &)) 
3. then return false 

4. return true 


Place (k, i) returns true if a queen can be placed in the k” row and i column 
otherwise return false. 


x[]is aglobal array whose first k — 1 values have been set. Abs(r) returns the 
absolute value of r. 


N-Queens (k, n) 
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1. fori«1ton 

2 do if PLACE (2, 7) 

3. then x[k] < i 

4. ifk=n, then print x[1.... N] 

5. else N-Queens (k + 1, n) 

[Note : For 8-Queen problem put n = 8 in the algorithm.] 


Que 4.18. | Write an algorithm for solving N-Queens problem. 
Show the solution of 4-Queens problem using backtracking 


approach. AKTU 2015-16, Marks 10 
Answer | 


Algorithm for N-Queens problem : Refer Q. 4.17, Page 4-21B, Unit-4. 
4-Queens problem : 


1. Suppose we have 4 x 4 chessboard with 4-queens each to be placed in 
non-attacking position. 


Ron 


Fig. 4.18.1. 


2. Now, we will place each queen on a different row such that no two 
queens attack each other. 


3. We place the queen q, in the very first accept position (1, 1). 
Now if we place queen q, in column 1 and 2 then the dead end is 
encountered. 

5. Thus, the first acceptable position for queen q, is column 3 i.e., (2, 3) but 
then no position is left for placing queen q, safely. So, we backtrack one 
step and place the queen q, in (2, 4). 


6. Now, we obtain the position for placing queen q, which is (3, 2). But later 
this position lead to dead end and no place is found where queen q, can 
be placed safely. 
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7. Then we have to backtrack till queen q, and place it to (1, 2) and then all 
the other queens are placed safely by moving queen q, to (2, 4), queen q, 
to (3, 1) and queen q, to (4, 3) i.e., we get the solution < 2, 4, 1, 3>. This 
is one possible solution for 4-queens problem. 





8. For other possible solution the whole method is repeated for all partial 
solutions. The other solution for 4-queens problem is <8, 1, 4, 2>i.e., 





9. Now, the implicit tree for 4-queen for solution <2, 4, 1, 3> is as follows : 


10. Fig. 4.18.5 shows the complete state space for 4-queens problem. But we 
can use backtracking method to generate the necessary node and stop 
if next node violates the rule i.e., if two queens are attacking. 
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Fig. 4.18.5. 


Que 4.19. | What is branch and bound technique ? Find a solution 


to the 4-Queens problem using branch and bound strategy. Draw 
the solution space using necessary bounding function. 


Answer | 


Branch and bound technique : 

1. Itis asystematic method for solving optimization problems. 
2. Itis used where backtracking and greedy method fails. 

3. Itis sometimes also known as best first search. 
4 


In this approach we calculate bound at each stage and check whether it 
is able to give answer or not. 


5. Branch and bound procedure requires two tools : 


a. The first one is a way of covering the feasible region by several 
smaller feasible sub-regions. This is known as branching. 


b. Another tool is bounding, which is a fast way of finding upper and 
lower bounds for the optimal solution within a feasible sub-region. 


Solution to 4-Queens problem : 
Basically, we have to ensure 4 things : 
1. No two queens share a column. 
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2. No two queens share a row. 
3. Notwo queens share a top-right to left-bottom diagonal. 
4. Notwo queens share a top-left to bottom-right diagonal. 


Number 1 is automatic because of the way we store the solution. For number 
2, 3 and 4, we can perform updates in O(1) time and the whole updation 
process is shown in Fig. 4.19.1. 





Fig. 4.19.1. 


PART-5 


Hamiltonian Cycles and Sum of Subsets. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 4.20. | What is backtracking ? Discuss sum of subset problem 


with the help of an example. AKTU 2017-18, Marks 10 
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Answer | 


Backtracking : Refer Q. 4.12, Page 4-13B, Unit-4. 
Sum of subset problem with example : 
In the subset-sum problem we have to find a subset s’ of the given set 
S=(S,,5,,S,, 0 , S_,) where the elements of the set S are n positive integers 
in such a manner that s’ € S and sum of the elements of subset ‘s” is equal to 
some positive integer ‘X’. 
Algorithm for sum-subset problem : 
Subset-Sum (S, f) 
Ceo 
Z<eS 
Keo 
t<t 
while (Z # ») do 
K<max(Z) 
if (K < t) then 

Z<Z-K 

t,<t,-K 
10. CeCuUK 
11. elseZ<- Z-K 
12. printC // Subset Sum elements whose 

// Sum is equal to t, 

This procedure selects those elements of S whose sum is equal to ¢t. Every 
time maximum element is found from S, if it is less than ¢ then this element 
is removed from Z and also it is subtracted from t. 





WONAaPONnr 


For example : 
Given S = <1, 2, 5, 7, 8, 10, 15, 20, 25> & m = 35 
Z<S,m=35 
k — max[Z] = 25 
K<m 
Z=Z-K 
i.e., Z = <1, 2,5, 7, 8, 10, 15, 20> & m, << m 
Subtracting K from m,, we get 
New m, = m,(old) — K = 35 — 25 = 10 
In new step, 
K< max[Z] = 20 
K>m, 
i.e., Z = <1, 2,5, 7, 8, 10, 15> 


In new step, 
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K€ max[Z] = 15 
K>m, 
L.e., Z = <1, 2, 5, 7, 8, 10> 
In new step, 
K< max[Z] = 10 
K>m, 
Le., Z = <1, 2, 5, 7, 8> 
In new step, 
K< max[Z] = 8 
K>m, 
Le., Z= <1, 2,5, 7> &m,<m, 
New m, =m,(old)-K=10-8= 2 
In new step 


K< max[Z] =7 


K>m, 
Le., Z = <1, 2, 5> 
In new step, K< max[Z] =5 
K>m, 
Le., Z= <1, 2> 
In new step, K€ max[Z] =2 
K>m, 
L.e., Z=<I1> 
In new step, 
K=1 
K<m, 
m, = 01 


Now only those numbers are needed to be selected whose sum is 01, therefore 
only lis selected from Z and rest other number found as max|Z] are subtracted 
from Z one by one till Z become 9. 


Que 4.21. | Solve the subset sum problem using backtracking, where 


n=4,m = 18, w[4] = {5, 10, 8, 13}. AKTU 2018-19, Marks 07 


Answer 


| 
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m= 18 
w{4} = {5, 10, 8, 13} 


Sorted order : w{4} = {5, 8, 10, 13} 
Now we construct state-space tree. 


First Subset 
Similarly, 






x 
S, = (5, 13} 
S, = {8, 10} 
Que 4.22. | Differentiate between backtracking and branch and 


bound approach. Write an algorithm for sum-subset problem 
using backtracking approach. 


Answer | 


Difference between backtracking and branch and bound technique : 


I = Include 
E = Exclude 




















S. No. Backtracking Branch and bound 

1. It is a methodological way of | It is a systematic method for 
trying out various sequences of | solving optimization problems. 
decisions. 

2. It is applied in dynamic | It is applied where greedy and 
programming technique. dynamic programming technique 

fails. 

3. It is sometimes called depth first | It is also known as best first 
search. search. 

4. | This approach is effective for | This approach is effective for 
decision problem. optimization problems. 

5. | Thisalgorithmis simple and easy | This algorithm is difficult to 
to understand. understand. 











Algorithm for sum-subset problem 


: Refer Q. 4.20, Page 4-26B, Unit-4. 














Dynamic Programming & Backtracking 4-30 B (CS/IT-Sem-5) 





Que 4.23. | Explain Hamiltonian circuit problem. Consider a graph 


G = (V, E) shown in Fig. 4.23.1 and find a Hamiltonian circuit using 
backtracking method. 


Fig. 4.23.1. 


Answer | 


Hamiltonian circuit problem : 
1. Given a graph G =(V, E), we have to find the Hamiltonian circuit using 
backtracking approach. 


2. We start our search from any arbitrary vertex, say ‘a’. This vertex ‘a’ 
becomes the root of our implicit tree. 


3. The first element of our partial solution is the first intermediate vertex 
of the Hamiltonian cycle that is to be constructed. 


4. The next adjacent vertex is selected on the basis of alphabetical (or 
numerical) order. 


5. Ifat any stage any arbitrary vertex makes a cycle with any vertex other 
than vertex ‘a’ then we say that dead end is reached. 


6. Inthis case we backtrack one step, and again search begins by selecting 
another vertex and backtrack the element from the partial solution 
must be removed. 


7. The search using backtracking is successful if a Hamiltonian cycle is 
obtained. 


Numerical : 


1. Firstly, we start our search with vertex ‘a’, this vertex ‘a’ becomes the 


root of our implicit tree. 
@)<— Root 


2. Next, we choose vertex 6’ adjacent to ‘a’ as it comes first in lexicographical 
order (b,c, d). 


(a) Root 


Oo © ®@ 


3. Next, we select ‘c’ adjacent to ‘b’ 
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(a) Root 
b © @ 


4. Next, we select ‘d’ adjacent to ‘c’ 


@) (©) 


5. Next, we select ‘e’ adjacent to ‘d’ 





6. Next, we select vertex ‘f’ adjacent to ‘e’. The vertex adjacent to f’ are ‘d’ 
and ‘e’ but they have already visited. Thus, we get the dead end and we 
backtrack one step and remove the vertex ‘f’ from partial solution. 
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Dead end 


7. From backtracking, the vertex adjacent to ‘e’ are ‘b’, ‘c’, ‘ad’, f’ from which 
vertex f’ has already been checked and ‘b’, ‘c’, ‘d’ have already visited. 
So, again we backtrack one step. Now, the vertex adjacent to ‘d’ are ‘e’, 
f°’ from which ‘e’ has already been checked and adjacent of ’ are ‘d’ and 
‘e’. If e’ vertex visited then again we get dead state. So again we backtrack 
one step. 

8. Now, adjacent to ‘c’ is ‘e’ and adjacent to ‘e’ is ‘f’ and adjacent to /’ is ‘a’ 
and adjacent to ‘d’ is ‘a’. Here, we get the Hamiltonian cycle as all the 
vertex other than the start vertex ‘a’ is visited only once (a—b —c-—e-f 
—d-a). 






Backtrack 


Dead end 
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Backtrack 


Dead end 


Dead end 


Again backtrack 


Backtrack 


9. Here we have generated one Hamiltonian circuit but other Hamiltonian 
circuit can also be obtained by considering other vertex. 
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VERY IMPORTANT QUESTIONS 


Following questions are very important. These questions 
may be asked in your SESSIONALS as well as 


UNIVERSITY EXAMINATION. 











Q. 1. What do you mean by dynamic programming ? 
Ans: Refer Q. 4.1. 


Q.2. Write down an algorithm to compute longest common 
subsequence (LCS) of two given strings. 
Ans: Refer Q. 4.4. 


Q. 3. Give the algorithm of dynamic 0/1-knapsack problem. 
Ans: Refer Q. 4.5. 


Q. 4. Describe the Warshall’s and Floyd’s algorithm for finding 
all pair shortest paths. 
Ans: Refer Q. 4.9. 


Q.5. What is backtracking ? Write general iterative algorithm 
for backtracking. 
Ans: Refer Q. 4.12. 


Q.6. Write short notes on N-Queens problem. 
Ans: Refer Q. 4.17. 


Q.7. Explain travelling salesman problem using backtracking. 
Ans: Refer Q. 4.13. 


Q. 8. Explain TSP using branch and bound technique. 
Ans: Refer Q. 4.14. 


Q.9. Write an algorithm for sum of subset problem. 
Ans: Refer Q. 4.20. 


Q.10. Compare the various programming paradigms such as 
divide-and-conquer, dynamic programming and greedy 
approach. 

Ans: Refer Q. 4.8. 


OOO 
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PART- 1 


Algebraic Computation, Fast Fourier Transform. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 5.1. | What is FFT (Fast Fourier Transformation) ? How the 


recursive FFT procedure works ? Explain. 


Answer | 


1. 


The Fast Fourier Transform (FFT) is a algorithm that computes a 
Discrete Fourier Transform (DFT) of n-length vector in O(n log n) 
time. 
In the FFT algorithm, we apply the divide and conquer approach to 
polynomial evaluation by observing that if n is even, we can divide a 
degree (n — 1) polynomial. 

A(x) = a) + a,x + yx” +. 4G, 4 nl 


into two degree (2 - 1 polynomials. 


2 n/2-1 
+..4G, 9K 


n/Q-1 


AM(x) = ay + agx + ayx 
AWN(x) = a, +a5x + agx” +t, 4X 
Where A" contains all the even index coefficients of A and A"! contains 
all the odd index coefficients and we can combine these two polynomials 
into A, using the equation, 
A(x) = All (2) + ~All (x?) ...(5.1.1) 
So that the problem of evaluating A(x) at w", where k = 0, 1, 2, ...,.n-1 
reduces to, 


Evaluating the degree (2-1) polynomial A(x) and A(x) at the 
point (w* )?i.e., 
(a®)?, (01, 0, (a? 1)? 


because we know that if”, is a complex n™ root of unity then (o*,)* is 


th 
a complex >= root of unity. Thus, we can evaluate each A(x) and 


A(x) at (o*,)? values. 
Combining the results according to the equation (5.1.1). This 
observation is the basis for the following procedure which computes 
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the DFT of an n-element vector a = (do, ay,..., a, _,) where for sake of 
simplicity, we assume that n is a power of 2. 


FFT (a, w): 

n < length [a] nis a power of 2. 
ifn=1 

then return a 

©, < erniin 


9 x will store powers of initially x = 1. 


xO 
al (do, dy,.+.4,, 9) 

all — (ay, dy, ...a,, 4) 

yl — FFT(a, «?) Recursive calls with w? as (n/2)" root of unity. 
yl — FFT(a, ian 


10. for k < 0 to (n/2)- 
11. doy, < Olax yl : 
12. Yasin) — yf) yh! 
13. x< xo, 
14. return y 
Line 2-3 represents the basis of recursion; the DFT of one element is the 
element itself. Since in this case 
Vo = Ay O,°=ay 1 =a, 
Line 6-7 defines the recursive coefficient vectors for the polynomials A! 
and All, @ = at 
Line 8-9 perform the recursive DFT, , computations setting for 


SOOO SOT A OOo RON 


k=0,1,2,. je Mies, 
2 


yl?) ~ AlMl(@2*) ; yl! ~ Ala?) 
Lines 11-12 combine the results of the recursive DFT,,, calculations. 
For Yq, Yas ++ Ying) nee 11 yields. 
Ye= Ie tOne 
= AMl(m?*) + @* AM(m2*) = A(o*) using equation (5.1.1) 


For y,/9) ¥(n/2)a. 0 Inv line 12 yields. 


Yes(ni2) = yl?) —of yl = = yo Ty wee?) yi [. ee = -o] 
= AlN 2h) 4 qytt(/2) All (ey2h 
= AM wo) + of AMO? wo) [on = 1] 
= AlOl (gy 2h+7) 4 gy btn?) Au (eee) 
= A(@h/2)) using equation (5.1.1) 


each k = 0, 1, 2, ...,(n/2) — 1. 
Thus, the vector y returned by the FFT algorithm will store the values of 
A(x) at each of the roots of unity. 
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Que 5.2. | What is the application of Fast Fourier Transform 
(FFT) ? Also write the recursive algorithm for FFT. 


AKTU 2018-19, Marks 10 
Answer | 


Application of Fast Fourier Transform : 

1. Signal processing. 

2. Image processing. 

3. Fast multiplication of large integers. 

4. Solving Poisson’s equation nearly optimally. 
Recursive algorithm : Refer Q. 5.1, Page 5-2B, Unit-5. 


PART-2 


String Matching. 








Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 5.3. | What is string matching ? Discuss string matching 
problem. Also define string, substring and proper substring. 


Answer | 


String matching is a process of finding one or more occurrences of a pattern 
ina text. 

String matching problem : 

Given a text array T[1..n] of n character and a pattern array P[1..m] of m 
characters. 

The problem is to find an integer s, called valid shift where 0<s <n—m and 
T[s +1....s+m]=P[1... mJ. 

We further assume that the elements of P and T are characters drawn from 
a finite alphabet = such as {0, 1} or {A, B, ... Z, a, b, ..., z}. 

String: A string is traditionally a sequence of character, either as a literal 
constant or as some kind of variable. 

Substring : Given a string T[1 .. n], the substring is defined as Ti .. j] for 
some 0 <i <j <n-—1, that is, the string formed by the characters in T from 
index /, inclusive. This means that a string is a substring of itself (simply take 
i=Oandj=m). 

Proper substring : The proper substring of string T[1 .. n] is Tli .. j] for 
some 0 <i<j<n-—1, that is, we must have either i > 0 orj<m-—1. 

Using these definition, we can say given any string T[1 .. n], the substring 
are 
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Thi... fj] = Thi) Th + 1) Thi + 2)... Ty 
for some 0 <i<j<n-1. 
And proper substrings are 

Ti .. fj] = Thi) Th + 1) Thi + 2)... Ty 
for some 0 <i<j<n-1. 
Note that ifi >j, then T[i ..j] is equal to the empty string or null, which has 
length zero. Using these notations, we can define of a given string T[1.. n] as 
TIO .. i] for some 0 <i < n — 1 and suffix of a given string T[1 — n] as 
Tl ..n—1] for some 0 <i <n-1l. 


Que 5.4. | What are the different types of string matching ? Explain 


one of them. 


Answer | 


Basic types of string matching algorithms are : 


String matching algorithm 


Naive string matching Rabin-Karp KMP (Knuth-Morris-Pratt) 
algorithm algorithm algorithm 


Fig. 5.4.1. 

Naive string matching : 

The Naive approach simply test all the possible placement of pattern P[1 .. m] 
relative to text T[1 .. n]. Specifically, we try shifts s = [0, 1, ...., n — ml, 
successively and for each shift, s, compare T[s + 1..s +m] to P[1.. ml]. 
Naive string matcher (T, P) 

1. n< length [T] 

2. m< length [P] 

3. fors<Oton-m 

4. doifP[1..m]=T[s +1..s+m] 

5. then print “pattern occurs with shift” s 

The Naive string matching procedure can he interpreted graphically as a 
sliding a pattern P[1.. m] over the text T[1.. m] and noting for which shift all 
of the characters in the pattern match the corresponding characters in the 
text. 

To analyze the time of Naive matching, the given algorithm is implemented 
as follows, note that in this implementation, we use notation P[1 .. j] to 
denote the substring of P from index i to index j. That is, P[1 ... j] = Pli] 
Pili +1)... PU. 

Naive string matcher (T, P) 

1. n< length [T| 

2. m< length [P] 

3. fors <0 ton-m do 

4 jel 
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5 while j < m and T[s +j] = Ply] do 

6. J<jtl 

7. if j >m then 

8 return valid shift s 

9. return no valid shift exist //i.e., there is no substring of T matching P. 


Que 5.5. | Show the comparisons that Naive string matcher makes 
for the pattern P = {10001} in the text T = {0000100010010} 


Answer | 


Given, P= 10001 
T = 0000100010010 


oof [ofa] oo | aloof a 
S=1 
Joo] of a| 


iil. 


BE: 
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vil. 





Que 5.6. | Write down Knuth-Morris-Pratt algorithm for string 


matching. Find the prefix function of the string ababababca. 


Answer 


| 


Knuth-Morris-Pratt algorithm for string matching : 
COMPUTE-PREFIX-FUNCTION (P) 


1. m<-length [P] 

2. xrlij<0 

3. k<0 

4. forq<2tom 

5. do while k > 0 and P [k + 1] + Plq] 
6. dok< x Ik] 

7. if P[k + 1] =P [q] 

8. thenk<k+1 

9. tiqdl<k 


10. return x 
KMP-MATCHER calls the auxiliary procedure COMPUTE-PREFIX- 
FUNCTION to compute z. 
KMP-MATCHER (T, p) 
n < length [T] 
m < length [P] 
mt < COMPUTE-PREFIX-FUNCTION (P) 
q<0 
fori<-lton 
do while g > 0 and P [q + 1] + Tli] 
dog< xlql 
if P [q +1] = TIi] 


Oaroarrwnr 
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9 theng<q+1 


10. ifg=m 


11. then print “pattern occurs with shift” i -—m 


12. q<nxlq] 


Prefix function of the string ababababca : 


m < length [P] 


3 m= 10 
Initially, P[1] =0,k=0 

for g< 2 to 10 

forg=2, k#0 

& P[0 + 1] = P[2] 
a m2] =0 
forg=3, k#0 

& P[0+ 1] = P[3] 
ao k<ek+1=1 
& m3] << 1 
forg=4,k>0 

& P{1+ 1] = P[4] 
ke1+1=2 
& ml4] < 2 
forqg=5,k>0 

& P[2 +1) = P[5] 
Ra ke24+1=38 
& m5] <— 3 
forg=6,k>0 

& P[3 + 1] = PI6] 
Es ke34+1=4 
& nl6] << 4 
forg=7,k>0 

& P[4 +1] = P[7] 
* ke 44+1=5 
& nl7] << 5 
forg=8,k>0 

& P[5 + 1] = P[8] 
. k<e5+1=6 
& n[8] << 6 
forg=9,k>0 

& P[6 + 1] = P[9] 
2 k<nlk] =6 
& n[9] — 6 
forg=10,k>0 

& P[6 + 1] = P[10] 
o ke64+1=7 
& n(10] << 7 
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Que 5.7. | Compute the prefix function x for the pattern P = abacab 
using KNUTH-MORRIS-PRATT algorithm. Also explain Naive string 


matching algorithm. AKTU 2017-18, Marks 10 
Answer | 


Prefix function of the string abacab : 
m < length [P] 


oe m=6 

Initially, x[1] = 0,2 =0 

forg< 2to6 

forq=2, k+0 

& P[0 + 1] + P[2] 

se n[2] = 0 

for qg=3, k+0 

& P[O + 1] = P[3] 

= k=k+1=1 

& n[3] = 1 

forg=4,k>0 

& P(1+1)# P[4] 

: k<nxll] =0 
P(1] # P[4] 

& 7[4] = 0 

forg=5,k>0 

& P(0 + 1] = PI5] 

a k<eO0+1=1 

& n[5] = 1 

forqg=6,k>0 

& P(1 + 1] = P[6] 

- ke14+1=2 

& n[6] = 2 











a1 | ofofaj[olil2. 





Naive string matching algorithm : Refer Q. 5.4, Page 5-5B, Unit-5. 
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Que 5.8. | Describe in detail Knuth-Morris-Pratt string matching 


algorithm. Compute the prefix function x for the pattern 
ababbabbabbababbabb when the alphabet is = = {a, b}. 


AKTU 2019-20, Marks 07 
Answer | 


Knuth-Morris-Pratt string matching algorithm : Refer Q. 5.6, 
Page 5—7B, Unit-5. 


Numerical : 
pattern = ababbabbabbababbabb 
length 19 
Initially, m1) =Oandk=0 
For q<2to9 
For q=2andk}#0 
P(0 + 1] + P[2]. 
n[2] = 0 
For q=3 
P(0 + 1] = P[3] 
k=k+1=1 
n[3] = 1 
For q=4k>0 
P{1 +1] = P[4] 
P[2] = P[4] 
k=k+1=2 
nl4] = 2 
For q=5k>0 
P[2 +1) + P[5] 
n[5] = 0 
For q=6 
P(0 + 1] = P[6] 
k=k+1=1 
n[6] = 1 
For q=7k>0 
P{1+ 1] = P[7] 
P{2] = P[7] 
k=k+1=2 
n[7] = 0 
For q=8k>0 
P(2 +1] = P[8] 
P(3] ¥ P[8] 
m8] = 0 
For q=9 
P(0 + 1] = P[9] 


k=k+1 
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For 


For 


For 


For 


For 


For 


For 


For 


For 


n[9] = 2 
q=10k>0 
P(2 +1] # P[10] 
n[10] = 0 
q=11k>0 
P(0O + 1] + P[11] 
n{11] = 0 
q=12k>0 
P(O + 1] + P[12] 
k=k+1 
m[12] = 2 
q=18k>0 
P(2 + 1] # P[13] 
n[13] = 0 
q=14 
P(O + 1] = P[14] 
k=k+1 
n[14] = 2 
q=15k>0 
P(2 +1] # P[15] 
n[15] = 0 
q=16k>0 
P(O + 1] + P[16] 
n[16] = 0 
q=17 
P(O + 1] + P[17] 
k=k+1 
n[17] = 2 
q=18k>0 
P(2 +1] # P[18] 
n[18] = 0 
q=19 
P(0O + 1] + P[19] 
n[19] = 0 











nil [of ol1{2{ofaf2{o{2| of o| 2]o [2 fo] of2]ojo| 





Que 5.9. | Write algorithm for Rabin-Karp method. Give a suitable 


example to explain it. 


OR 


What is string matching algorithm ? Explain Rabin-Karp method 


with examples. 


AKTU 2015-16, Marks 10 
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Answer | 


String matching algorithm : Refer Q. 5.3, Page 5-4B, Unit-5. 
The Rabin-Karp algorithm : 
The Rabin-Karp algorithm states that if two strings are equal, their hash 
values are also equal. This also uses elementary number-theoretic notions 
such as the equivalence of two numbers module a third. 
Rabin-Karp-Matcher (T, P, d, q) 
1. n< length [T] 

. m<«€ length [P] 





2 

3. h<«ed™modq 

4. p<O0 

5. t,<0 

6. fori<-ltom 

7 do p « (dp + p [i]) modqg 
8 ty < (dt, + Tli]) mod q 
9. fors<Oton-—m 


10. doifp =t, 

11. then if p [1....m] = T[s + 1...... s+m] 
12. then “pattern occurs with shift” s 
13. ifs<n-m 


14. thent,, ,< (d¢,-T [s + 1] h) + Tls + m +1]) mod gq 

Example of Rabin-Karp method : Working modulo qg = 11, how many 

spurious hits does the Rabin-Karp matcher encounter in the text 

T = 3141592653589793 when looking for the pattern p = 26 

Given, p=26andq=11 

Now we divide 26 by 11i.e., 

Remainder is 4 and m = 2. 

We know m denotes the length of p. 
Tishil4]i[slol2lels[3lsislol7iol 3. 

LLU 

Now we divide 31 by 11, and get remainder is 9. 

Similarly, 14 by 11 and get remainder is 3. 

So, continue this step till last i.e., 93 is divided by 11 and get remainder is 5. 

After that we will store all remainder in a table. 


9} a{s]a}a[a]s]ioj | 2}s}i}ol2]s| 


Now we find valid matching. 











The number of spurious hits is 3. 
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Que 5.10. | Give a linear time algorithm to determine if a text Tis a 
cycle rotation of another string T. For example: RAJA and JARA are 


cyclic rotations of each other. AKTU 2018-19, Marks 10 
Answer | 


Knuth-Morris-Pratt algorithm is used to determine if a text T is a cycle 
rotation of another string T". 
Knuth-Morris-Pratt algorithm : Refer Q. 5.6, Page 5-7B, Unit-5. 


PART-3 


Theory of NP — Completeness. 





Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 5.11. | Discuss the problem classes P, NP and NP-complete. 


| 


Answer 


P: Class P are the problems which can be solved in polynomial time, which 
take time like O(n), O(n?), O(n). 

Example : Finding maximum element in an array or to check whether a 
string is palindrome or not. So, there are many problems which can be 
solved in polynomial time. 

NP : Class NP are the problems which cannot be solved in polynomial time 
like TSP (travelling salesman problem). 


Example : Subset sum problem is best example of NP in which given a set 
of numbers, does there exist a subset whose sum is zero, but NP problems 
are checkable in polynomial time means that given a solution of a problem, 
we can check that whether the solution is correct or not in polynomial time. 
NP-complete : The group of problems which are both in NP and NP-hard 
are known as NP-complete problem. 

Now suppose we have a NP-complete problem R and it is reducible to Q 
then Q is at least as hard as R and since R is an NP-hard problem, therefore 
Q will also be at least NP-hard, it may be NP-complete also. 


Que 5.12. | Discuss the problem classes P, NP and NP-complete 


with class relationship. AKTU 2017-18, Marks 10 
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Answer | 


1. The notion of NP-hardness plays an important role in the relationship 
between the complexity classes P and NP. 





V4 NP-complete 


- 
@ NP-hard 


P 


Fig. 5.12.1. Relationship among P, NP, NP-complete 
and NP-hard problems. 


2.  Itis also often used to define the complexity class NP-complete which is 
the intersection of NP and NP-hard. 

3. Consequently class NP-hard can be understood as the class of problems 
that are NP-complete or harder. 

4. There are no polynomial time algorithms for NP-hard problems. 

5. A problem being in NP means that the problem is “easy” (in a certain 
specific sense), whereas a problem being NP-hard means that the 
problem is “difficult” (in another specific sense). 

6. Aproblem being in NP and a problem being NP-hard are not mutually 
exclusive. When a problem is both in NP and NP-hard, we say that the 
problem is NP-complete. 

7. All problems in NP can be solved deterministically in time O(27). 

8. Anexample ofan NP-hard problem is the decision problem subset-sum. 
Given a set of integers, does any non-empty subset of them add up to 
zero ? i.e., a yes or no question, and happens to be NP-complete. 

9. Thereare, also decision problems that are NP-hard but not NP-complete. 

10. For example, in the halting problem “given a program and its input, will 
it run forever” i.e., yes or no question, so this is a decision problem. It is 
case to prove that the halting problem is NP-hard but not NP-complete. 


Que 5.13. | What is NP-completeness ? 


Answer | 


A language Lc {0,1}* is NP-complete if it satisfies the following two properties : 
if LeNP;and 

i. For every L’ < L 

NP-hard: If a language L satisfies property (ii), but not necessarily property 
(i), we say that L is NP-hard. 

NP-complete: We use the notation LeNPC to denote that L is NP-complete. 
Theorem : If any NP-complete problem is polynomial time solvable, then 
P = NP. If any problem in NP is not polynomial time solvable, then all NP 
complete problems are not polynomial time solvable. 
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Proof: Suppose that L ¢ P and also that L ¢ NPC. For any L'c NP, we have 
L'e _ L by property (ii) of the definition of NP-completeness. We know if 
L's L then L ¢ Pimplies L' < P, which proves the first statement. 

To prove the second statement, suppose that there exists and L ¢ NP such 
that L ¢ P. Let L'e NPC be any NP-complete language, and for the purpose 
of contradiction, assume that L'< P. But then we have L a L' andthus L e€ P. 


Que 5.14. | Explain NP-hard and NP-complete problems and also 


define the polynomial time problems and write a procedure to 
solve NP-problems. 

OR 
Write short note on NP-hard and NP-complete problems. 

OR 
Define NP-hard and NP-complete problems. What are the steps 
involved in proving a problem NP-complete ? Specify the problems 


already proved to be NP-complete. AKTU 2019-20, Marks 07 
Answer | 


NP-hard problem : 

1. We say that a decision problem P, is NP-hard if every problem in NP is 
polynomial time reducible to P... 

2. Insymbols, 

P; is NP-hard if, for every P; < NP, P > P, 

This does not require P, to be in NP. 

Highly informally, it means that P, is ‘as hard as’ all the problem in NP. 

If P, can be solved in polynomial time, then all problems in NP. 

Existence of a polynomial time algorithm for an NP-hard problem implies 

the existence of polynomial solution for every problem in NP. 

NP-complete problem : 

1. There are many problems for which no polynomial time algorithms is 
known. 

2. Some ofthese problems are travelling salesman problem, optimal graph 
colouring, the Knapsack problem, Hamiltonian cycles, integer 
programming, finding the longest simple path in a graph, and satisfying 
a Boolean formula. 

3. These problems belongs to an interesting class of problems called the 
“NP-complete” problems, whose status is unknown. 

4. The NP-complete problems are traceable i.e., require a super polynomial 
time. 

Polynomial time problem : 


An algorithm is said to be solvable in polynomial time if the number of steps 
required to complete the algorithm for a giveninput is O(n*) for some non- 
negative integer k where n is the complexity of input. 


oO oP wo 
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Polynomial time verifiable algorithm : A polynomial time algorithm A 
is said to be polynomial time verifiable if it has following properties : 


1. 


2. 
3. 


4. 


The input to A consists of an instance I of X (X is a decision problem) and 
astring S such that the length of S is bounded by some polynomial in the 
size of I. 

The output of A is either yes or no. 

If is anegative instance of X, then the output of A is “no” regardless of 
the value of S. 

If J is a positive instance of X, then there is at least one choice of S for 
which A output “yes”. 


Procedure to solve NP-problems : 


1. 


- 


on 


= 


The class NP is the set of all decision problems that have instances that 
are solvable in polynomial time using a non-deterministic turing machine. 
In a non-deterministic turing machine, in contrast to a deterministic 
turing machine, for each state, several rules with different actions can 
be applied. 

Non-deterministic turing machine branches into many copies that are 
represented by a computational tree in which there are different 
computational paths. 

The class NP corresponds to a non-deterministic turing machine that 
guesses the computational path that represents the solution. 

By doing so, it guesses the instances of the decision problem. 

In the second step, a deterministic turing machine verifies whether the 
guessed instance leads to a “yes” answer. 

It is easy to verify whether a solution is valid or not. This statement does 
not mean that finding a solution is easy. 


ue 5.15. | Differentiate NP-complete with NP-hard. 


gases 


S. No. NP-complete NP-hard 





AKTU 2016-17, Marks 10 


An NP-complete problems | NP-hard problems is one to which 
is one to which every other | an NP-complete problem is 
polynomial-time non- Turing-reducible. 

deterministic algorithm can 
be reduced in polynomial 
time. 


NP-complete problems do | NP-hard problems correspond to 


not corresponds to an | an NP-complete problem. 
NP-hard problem. 























Design and Analysis of Algorithms 5-17 B (CS/IT-Sem-5) 








NP-complete problems are | NP-hard problems need not to be 
exclusively decision decision problem. 
problem. 





NP-complete problems | NP-hard problems do not have to 
have to be in NP-hard and | bein NP. 
also in NP. 








For example : 3-SAT | For example: Halting problem is 
vertex cover problem is | NP-hard. 
NP-complete. 














Q 


Geese] 


ue 5.16. | Discuss NP-complete problem and also explain minimum 


vertex cover problem in context to NP-completeness. 


An 


swer 


NP-complete problem : Refer Q. 5.14, Page 5-15B, Unit-5. 
Minimum vertex cover problem : 


1. 


2. 


A vertex cover of a graph is a set of vertices such that each edge of the 
graph is incident to at least one vertex of the set. 

The problem of finding a minimum vertex cover is a classical optimization 
problem in computer science and is a typical example of an NP-hard 
optimization problem that has an approximation algorithm. 

Its decision version, the vertex cover problem, was one of Karp's 21 NP- 
complete problems and is therefore a classical NP-complete problem in 
computational complexity theory. 

Furthermore, the vertex cover problem is fixed-parameter tractable 
and acentral problem in parameterized complexity theory. 

The minimum vertex cover problem can be formulated as a half-integral 
linear program whose dual linear program is the maximum matching 
problem. 

Formally, a vertex cover V’ of undirected graph G = (V, F) is a subset of 
V such that uw e V' vue V'ie., itis a set of vertices V’ where every edge 
has at least one endpoint in the vertex cover V’. Such a set is said to 
cover the edges of G. 

Example : Fig. 5.16.1 shows examples of vertex covers, with some 
vertex cover V’ marked in dark. 


a ft 


Fig. 5.16.1. 
A minimum vertex cover is a vertex cover of smallest possible size. 
The vertex cover number t is the size of aminimum cover, i.e.,t= | V’|. 
The Fig. 5.16.2 shows examples of minimum vertex covers in the previous 
graphs. 
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de oo" 


Fig. 5.16.2. 





Que 5.17. | Discuss different types of NP-complete problem. 


Answer 


| 


Types of NP-complete problems : 


NP-complete problems 
Hamiltonian cycle problem Clique problem 


Fig. 5.17.1. 





Hamiltonian cycle problem : 

1. A Hamiltonian cycle of an undirected graph G = (V, FE) isa simple cycle 
that contains each vertex in V. 

2. A graph that contains a Hamiltonian cycle is said to be Hamiltonian, 
otherwise it is said to be non-Hamiltonian. 

The clique problem : 

1. Aclique in an undirected graph G = (V, E) is asubset V' c V of vertices, 
each pair of which is connected by an edge in E. 

2. The size of aclique is the number of vertices it contains. 
CLIQUE = {<G, K>: Gis a graph with a clique of size K} 


3. The clique problem is the optimization problem of finding a clique of 
maximum size in a graph. 
4. Asa decision problem, we ask simply whether a clique of a given size k 


exists in the graph. 
Que 5.18. | Show that Hamiltonian circuit is NP-complete. 


Answer | 


Theorem : Hamiltonian circuit (HC) is NP-complete. 

Proof: 

1. Let us define a non-deterministic algorithm A that takes, as input, a 

graph G encoded as an adjacency list in binary notation, with the vertices 

numbered 1 to N. 

We define A to first iteratively call the choose method to determine a 

sequence S of N + 1 numbers from 1 to N. 

3. Then, we have A to check that each number from 1 to N appears exactly 
once in S (for example, by sorting S), except for the first and last numbers 
in S, which should be the same. 


~) 
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4. Then, we verify that a sequence S defines a cycle of vertices and edges 
inG. 

5. Abinary encoding of the sequence S is clearly of size at most n, where n 
is the size of the input. Moreover, both of the checks made on the 
sequence S can be done in polynomial time in n. 


6. Observe that if there is a cycle in G that visits each vertex of G exactly 
once; returning to its starting vertex, then there is a sequence S for 
which A will output “yes.” 

7. Likewise, if A outputs “yes,” then it has found a cycle in G that visits 


each vertex of G exactly once, returning to its starting point. Hence, 
Hamiltonian circuit is NP-complete. 


Que 5.19. | Show that CLIQUE problem is NP-complete. 


Answer | 


Problem : The CLIQUE problem is defined as {< G, k >|, Gis a graph with 

ak-clique}. Show that CLIQUE is NP-complete. 

Proof : 

1. First, to show that CLIQUE is in NP. Given an instance of < G, k > and 
a k-clique we can easily verify in O(n?) time that we do, in fact, have a 
k-clique. 

2. Now, we want to show that 3-SAT is CLIQUE. Let F be a boolean 
formula in CNF. 

3. For each literal in F we will make a vertex in the graph i.e., 





(x, + X, +x) (%, + x, + X,) has 6 vertices. 


Let k be the number of clauses in F. 


4. Wewill connect each vertex to all of the other vertices that are logically 
compatible except for the ones that are in the same clause. 
5. Now, if we have a satisfiable assignment we will have a k-clique because 


the satisfying vertices will all be connected to one another. 
6. Thus, we can use CLIQUE to solve 3-SAT so CLIQUE is NP-complete. 


Que 5.20. | Define different complexity classes in detail with 
suitable example. Show that TSP problem is NP-complete. 


Answer 


| 


Different complexity classes : 

There are some complexity classes involving randomized algorithms : 

1. Randomized polynomial time (RP) : The class RP consists of all 
languages L that have a randomized algorithm A running in worst case 
polynomial time such that for any input x in =* 


1 
x € L => P[A(x) accepts] > 3 
x ¢€L => P[A(x) accepts] = 0 
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Independent repetitions of the algorithms can be used to reduce the 
probability of error to exponentially small. 
Zero-error probabilistic polynomial time (ZPP) : The class ZPP is 
the class of languages which have Las Vegas algorithms running in 
expected polynomial time. 

ZPP = RP co-RP 
where a language L is in co-X where X is a complexity class if and only 
if its complement &* — L is in X. 
Probabilistic polynomial time (PP) : The class PP consists of all 
languages L that have a randomized algorithm A running in worst case 
polynomial time such that for any input x in D*. 


1 
x € L=> P[A(x) accepts] > 2 


1 
x¢L = PlA() accepts] < a 


To reduce the error probability, we cannot repeat the algorithm several 
times on the same input and produce the output which occurs in the 
majority of those trials. 

Bounded-error probabilistic polynomial time (BPP) : The class 
BPP consists of all languages that have a randomized algorithm A 
running in worst case polynomial time such that for any input x in 2*. 


3 
x € L=> P[A(x) accepts] > Fi 
1 
x ¢L= P[A(x) accepts] < 4 
For this class of algorithms, the error probability can be reduced to 1/ 
2n with only a polynomial number of iterations. 
For a given a graph G = (V, £) and a number &, does there exist a tour 
C on G such that the sum of the edge weights for edges in C is less than 
or equal to k. 


Proof: 
Part 1: TSP isin NP. 
Proof: 


1. 
2. 


Let a hint S be a sequence of vertices V = vj...., v,,- 

We then check two things : 

a. First we check that every edge traversed by adjacent vertices is an 
edge in G, such that the sum of these edge weights is less than or 
equal to k. 

b. Secondly we check that every vertex in G is in V, which assures 
that every node has been traversed. 

We accept S if and only if S satisfies these two questions, otherwise 

reject. 

Both of these checks are clearly polynomial, thus our algorithm forms a 

verifier with hint S, and TSP is consequently in NP. 
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Part 2: TSP is NP-Hard. 

Proof: 

1. Toshow that TSP is NP-Hard, we must show that every problem y in NP 
reduces to TSP in polynomial time. 

2. Todo this, consider the decision version of Hamiltonian Cycle (HC). 

3. Take G=(V, E), set all edge weights equal to 1, and let k= | V| =n, that 
is, k equals the number of nodes in G. 

4. Any edge not originally in G then receives a weight of 2 (traditionally 
TSP is on a complete graph, so we need to add in these extra edges). 

5. Then pass this modified graph into TSP, asking if there exists atour on 
G with cost at most k. If the answer to TSP is YES, then HC is YES. 
Likewise if TSP is NO, then HC is NO. 

First direction : HC has a YES answer => TSP has a YES answer. 

Proof : 

1. IfHC has a YES answer, then there exists a simple cycle C that visits 
every node exactly once, thus C has n edges. 

2. Since every edge has weight 1 in the corresponding TSP instance for the 
edges that are in the HC graph, there is a Tour of weight n. Since k =n, 
and given that there is a tour of weight n, it follows that TSP has a YES 
answer. 

Second direction : HC has a NO answer => TSP has a NO answer. 

Proof : 

1. IfHC hasa NO answer, then there does not exist a simple cycle C in G 

that visits every vertex exactly once. Now suppose TSP has a YES 

answer. 

Then there is a tour that visits every vertex once with weight at most k. 

Since the tour requires every node be traversed, there are n edges, and 

since k = n, every edge traversed must have weight 1, implying that 

these edges are in the HC graph. Then take this tour and traverse the 

same edges in the HC instance. This forms a Hamiltonian Cycle, a 

contradiction. 

This concludes Part 2. Since we have shown that TSP is both in NP and 

NP-Hard, we have that TSP is NP-Complete. 


Que 5.21. | Prove that three colouring problem is NP-complete. 


AKTU 2016-17, Marks 10 


wr 


| 


Answer 


1. Toshowthe problem is in NP, let us take a graph G(V, E) and a colouring 
c, and checks in O(n? ) time whether c is a proper colouring by checking 
if the end points of every edge e € E have different colours. 


To show that 3-COLOURING is NP-hard, we give a polytime reduction 
from 3-SAT to 3-COLOURING. 


~) 
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3. 


10. 
11. 


12. 


13. 


14. 


That is, given an instance ¢ of 3-SAT, we will construct an instance of 

3-COLOURING (i.e., a graph G(V, £)) where G is 3-colourable iff is 

satisfiable. 

Let > be a 3-SAT instance and C,, C,, ..., C,,, be the clauses of > defined 

over the variables {x,, x5, ..., x,}. 

The graph G(V, E) that we will construct needs to capture two things : 

a. Somehow establish the truth assignment for x,, xo, ..., x,, via the 
colours of the vertices of G; and 

b. Somehow capture the satisfiability of every clause C, in 9. 

To achieve these two goals, we will first create a triangle in G with three 

vertices {7, F, B} where T stands for True, F for False and B for Base. 

Consider {T, F, B} as the set of colours that we will use to colour (label) 

the vertices of G. 

Since this triangle is part of G, we need 3 colours to colour G. 


Now we add two vertices v,, 0; for every literalx, and create a triangle B, 


v; ,0; for every (vu, , 0; ) pair, as shown in Fig. 5.21.1. 





Fig. 5.21.1. 
This construction captures the truth assignment of the literals. 
Since if G is 3-colourable, then either v, or 0, gets the colour T, and we 


interpret this as the truth assignment to v,. 

Now we need to add constraints to G to capture the satisfiability of the 
clauses of o. 

To do so, we introduce the Clause Satisfiability Gadget, (the OR-gadget). 
For aclause C, = (a v b vc), we need to express the OR of its literals using 
our colours {T, F, B}. 

We achieve this by creating a small gadget graph that we connect to the 
literals of the clause. The OR-gadget is constructed as follows : 
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15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 


26. 


Consider this gadget graph as a circuit whose output is the node labeled 
av bvc. We basically want this node to be coloured T if C; is satisfied and 
F otherwise. 

This is a two step construction : The node labelled a v 6 captures the 

output of (a v b) and we repeat the same operation for ((a v b) vc). If we 

play around with some assignments to a, b, c, we will notice that the 
gadget satisfies the following properties : 

a. Ifa,b,c areall coloured F in a 3-colouring, then the output node of 
the OR-gadget has to be coloured F. Thus capturing the 
unsatisfiability of the clause C,; = (av b vc). 

b. If one of a, b, c is coloured T, then there exists a valid 
3-colouring of the OR-gadget where the output node is coloured T. 
Thus again capturing the satisfiability of the clause. 

Once we add the OR-gadget of every C; in $, we connect the output node 

of every gadget to the Base vertex and to the False vertex of the initial 

triangle, as follows : 





Fig. 5.21.3. 


Now we prove that our initial 3-SAT instance 4 is satisfiable if and only 
the graph G as constructed above is 3-colourable. Suppose 9 is satisfiable 
and let (x,*, x,*, ...,x,* ) be the satisfying assignment. 


Ifx,* is assigned True, we colour v; with T and 0; with F (recall they are 


connected to the Base vertex, coloured B, so this is a valid colouring). 
Since ¢ is satisfiable, every clause C, = (a v b vc) must be satisfiable, 7.e., 
at least of a, b, c is set to True. By the property of the OR-gadget, we 
know that the gadget corresponding to C, can be 3-coloured so that the 
output node is coloured T. 

And because the output node is adjacent to the False and Base vertices 
of the initial triangle only, this is a proper 3-colouring. 

Conversely, suppose G is 3-colourable. We construct an assignment of 
the literals of » by setting x, to True if v; is coloured T and vice versa. 
Now consider this assignment is not a satisfying assignment to , then 
this means there exists at least one clause C;, = (a v b vc) that was not 
satisfiable. 

That is, all of a, b, c were set to False. But if this is the case, then the 
output node of corresponding OR-gadget of C; must be coloured F. 
But this output node is adjacent to the False vertex coloured F; thus 
contradicting the 3-colourability of G. 

To conclude, we have shown that 3-COLOURING is in NP and that it is 
NP-hard by giving a reduction from 3-SAT. 
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27. Therefore 3-COLOURING is NP-complete. 
Que 5.22. | Prove that P is the subset of NP. 


Answer | 


To prove: P is the subset of NP. 

Proof: 

1. IfL ¢P,thenLeNP, as there is a polynomial time algorithm to decide L, 
this algorithm can easily be converted into a row argument verification 
algorithm that simply ignores any exception and accepts exactly those 
input strings it determines to be in L. 


2. Thus, PcNP. 
NP 
(a) (b) 





Fig. 5.22.1. P Vs NP. 


PART-4 


Approximation Algorithm. 





Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 5.23. | Describe approximation algorithm in detail. How it 


differ with deterministic algorithm. Show that TSP is 2 approximate. 
OR 
Explain approximation algorithms with suitable examples. 


AKTU 2015-16, 2017-18; Marks 10 
Answer | 


Approximation algorithm : 

1. An approximation algorithm is a way of dealing with NP-completeness 
for optimization problem. This technique does not guarantee the best 
solution. 

2. The best of an approximation algorithm is to come as close as possible to 
the optimum value in a reasonable amount of time which is at most 
polynomial time. 
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3. Let c(i) be the cost of solution produced by approximate algorithm and 
c*(i) be the cost of optimal solution for some optimization problem 
instance 1. 

4. For minimization and maximization problem, we are interested in finding 
a solution of a given instance 7 in the set of feasible solutions, such that 
c(i) /c*(i) and c*(i)/ c(i) be as small as possible respectively. 

5. Wesay that an approximation algorithm for the given problem instance 
i, has a ratio bound of p(n) if for any input of size n, the cost c of the 
solution produced by the approximation algorithm is within a factor of 
p(n) of the cost c* of an optimal solution. That is 

max(c(i) / c*(Z), c*(t) / c(i)) < p(n) 
The definition applies for both minimization and maximization problems. 

6. p(n) is always greater than or equal to 1. If solution produced by 
approximation algorithm is true optimal solution then clearly we have 
p(n) =1. 

7. For aminimization problem, 0 <c*(Z) < c(i), and the ratio c(z)/c*(z) gives 
the factor by which the cost of the approximate solution is larger than 
the cost of an optimal solution. 

8. Similarly, for a maximization problem, 0 < c(i) < c*(z), and the ratio 
c*(z) / c(t) gives the factor by which the cost of an optimal solution is 
larger than the cost of the approximate solution. 

Difference between deterministic algorithm and approximation 

algorithm : 























S.No. | Deterministic algorithm Approximation algorithm 
1. It does not deal with optimization|It deals with optimization 
problem. problem. 
2. It has initial and final step. It does not have initial or final 
state. 
3. It require finite state machine. {It does not require finite state 
machine. 
It fails to deliver a result. It gives an optimal result. 
It does not apply to maximization |It applies to maximization and 
or minimization problem. minimization problem. 








Proof: 
TSP is 2-approximate : 
Let H* denote the optimal tour. Observe that a TSP with one edge removed 
is a spanning tree (not necessarily MST). 
It implies that the weight of the MST ‘T’ is in lower bound on the cost of an 
optimal tour. 
c(T) < c(H*) 
A “Full” walk, W, traverse every edge of MST, T, exactly twice. That is, 
c(W) = 2c(T) 
which means 
c(W) < 2c(H*) 
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and we have 

c(W) / c(A*) < p(n) = 2 
That is, the cost of walk, c(W), of the solution produced by the algorithm is 
within a factor of p(n) = 2 of the cost c(A*) of an optimal solution. 


Que 5.24. | Explain vertex cover problem with algorithm and 


analysis. 


Answer | 


A vertex cover of an undirected graph G = (V, E) is a subset of V’ c V such 
that if edge (u, v) e Gthen uw € V' oru e€ V' (or both). 

Problem : Find a vertex cover of maximum size in a given undirected graph. 
This optimal vertex cover is the optimization version of an NP-Complete 
problem but it is not too hard to find a vertex cover that is near optimal. 
Approx-vertex-cover (G : Graph) 

ceo 

E'< E(G 

while E’ is not empty 

do Let (u, v) be an arbitrary edge of E’ 

c€éc U{u, v} 

Remove from E’ every edge incident on either u or v 

. returnc 

Analysis : It is easy to see that the running time of this algorithm is 
O(V + £), using adjacency list to represent EF’. 


NOOB wp 


i 


Que 5.25. | Describe approximation algorithm in detail. What is 


the approximation ratio ? Show that vertex cover problem is 
2-approximate. 


Answer 


Approximation algorithm : Refer Q. 5.23, Page 5-24B, Unit-5. 
Proof: 
Vertex cover problem is 2-approximate : 
Goal : Since this is a minimization problem, we are interested in smallest 
possible c /c*. Specifically we want to show c/c* =2 =p(n). 
In other words, we want to show that Approx-Vertex-Cover algorithm returns 
a vertex-cover that is almost twice the size of an optimal cover. 
Proof : Let the set c and c* be the sets output by Approx-Vertex-Cover and 
Optimal-Vertex-Cover respectively. Also, let A be the set of edges. 
Because, we have added both vertices, we get c = 2|A| but Optimal-Vertex- 
Cover would have added one of two. 

c/lc* < p(n) = 2. 
Formally, since no two edge in A are covered by the same vertex from c* and 
the lower bound : |c*|ZA ...(5.25.1) 
on the size of an Optimal-Vertex-Cover. 
Now, we pick both end points yielding an upper bound on the size of Vertex- 
Cover : 


| 
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|el<2|A| 
Since, upper bound is an exact in this case, we have 
Jc|=2|A| ...(5.25.2) 
Take |c|/2= |A| and put it in equation (5.25.1) 
Jc*|= |e|/2 
|c*|/|c|=> 1/2 
|c*|/|c|< 2 = p(n) Hence the theorem proved. 


Que 5.26. | Explain Travelling Salesman Problem (TSP) with the 


triangle inequality. 


Answer | 


Problem : Given a complete graph with weights on the edges, find a cycle of 

least total weight that visits each vertex exactly once. When the cost function 

satisfies the triangle inequality, we can design an approximate algorithm for 

TSP that returns a tour whose cost is not more than twice the cost of an 

optimal tour. 

APPROX-TSP-TOUR (G,c): 

1. Select a vertex r < VIG] to be a “root” vertex. 

2. Compute a minimum spanning tree T for G from root r using MST- 
PRIM (G, c, r). 

3. Let L be the list of vertices visited in a pre-order tree walk of T. 

4. Return the Hamiltonian cycle H that visits the vertices in the order L. 

Outline of an approx-TSP tour : First, compute a MST (minimum spanning 

tree) whose weight is a lower bound on the length of an optimal TSP tour. 

Then, use MST to build a tour whose cost is no more than twice that of MST’s 

weight as long as the cost function satisfies triangle inequality. 


Que 5.27. | Write short notes on the following using approximation 


algorithm with example. 
i. Nearest neighbour 
ii. Multifragment heuristic 


Answer | 


i. Nearest neighbour : 
The following well-known greedy algorithm is based on the nearest- 
neighbour heuristic i.e., always go next to the nearest unvisited city. 
Step 1: Choose an arbitrary city as the start. 
Step 2: Repeat the following operation until all the cities have been 
visited : go to the unvisited city nearest the one visited last (ties can be 
broken arbitrarily). 
Step 3: Return to the starting city. 
Example : 

1. For the instance represented by the graph in Fig. 5.27.1, with a as the 
starting vertex, the nearest-neighbour algorithm yields the tour 
(Hamiltonian circuit) s,:a—b-—c—d-—a of length 10. 
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2. 


ii. 


The optimal solution, as can be easily checked by exhaustive search, is 
the tour s*: a—b —d—c—a of length 8. Thus, the accuracy ratio of this 
approximation is 


_ flsq) _10 _ 
~ f(s*) 8 a 


i.e., tour s, is 25 % longer than optimal tour s*. 





s_) 





Fig. 5.27.1. Instance of the traveling salesman problem. 


Unfortunately, except for its simplicity, not many good things can be 
said about the nearest-neighbour algorithm. 

In particular, nothing can be said in general about the accuracy of 
solutions obtained by this algorithm because it can force us to traverse 
a very long edge on the last leg of the tour. 

Indeed, if we change the weight of edge (a, d) from 6 to an arbitrary 
large number w = 6 in given example, the algorithm will still yield the 
tour a—b—c—d-—a of length 4 + w, and the optimal solution will still be 
a-—b-—d-c~—a of length 8. Hence, 

f(s,) _ 4+w 

f(s*) 8 

which can be made as large as we wish by choosing an appropriately 
large value of w. Hence, RA = ~ for this algorithm. 

Multifragment heuristic : 

Another natural greedy algorithm for the traveling salesman problem 
considers it as the problem of finding a minimum-weight collection of 
edges in a given complete weighted graph so that all the vertices have 
degree 2. 

Step 1 : Sort the edges in increasing order of their weights. (Ties can be 
broken arbitrarily.) Initialize the set of tour edges to be constructed to 
the empty set. 

Step 2: Repeat this step n times, where n is the number of cities in the 
instance being solved : add the next edge on the sorted edge list to the 
set of tour edges, provided this addition does not create a vertex of 
degree 3 or a cycle of length less than n; otherwise, skip the edge. 
Step 3: Return the set of tour edges. 

Example : 

Applying the algorithm to the graph in Fig. 5.27.1 yields 
{(a, b), (c, d), (6, c), (a, d)}. 


r(s) = 
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2. There is, however, avery important subset of instances, called Euclidean, 
for which we can make a non-trivial assertion about the accuracy of 
both the nearest-neighbour and multifragment-heuristic algorithms. 

3. These are the instances in which intercity distances satisfy the following 
natural conditions : 

a. Triangle inequality : d[i, 7 | < dli, k] + d[k,j | for any triple of 
cities i, 7, and k (the distance between cities i andj cannot exceed 
the length of a two-leg path from i to some intermediate city k to). 

b. Symmetry: d[i,j | =dlj, i] for any pair of cities i andj (the distance 
from i to) is the same as the distance from to /). 

4. Asubstantial majority of practical applications of the traveling salesman 
problem are its Euclidean instances. 

5. They include, in particular, geometric ones, where cities correspond to 
points in the plane and distances are computed by the standard Euclidean 
formula. 

6. Although the performance ratios of the nearest-neighbour and 
multifragment-heuristic algorithms remain unbounded for Euclidean 
instances, their accuracy ratios satisfy the following inequality for any 
such instance with n > 2 cities : 








ge f(s.) _ 4+w 
e Fey. 8 
where f(s) and f (s*) are the lengths of the heuristic tour and shortest 


tour. 


Que 5.28. | What is an approximation algorithm ? What is meant 


by p(n) approximation algorithms ? Discuss approximation 
algorithm for Travelling Salesman Problem. 


AKTU 2019-20, Marks 07 
Answer | 


Approximation algorithm : Refer Q. 5.23, Page 5-24B, Unit-5. 

p(n) approximation algorithm : A is a p(n) approximate algorithm if and 
only if for every instance of size n, the algorithm achieves an approximation 
ratio of p(n). It is applied to both maximization (0 < C(i) < C*(i)) and 
minimization (0 < C* (i) < C(i)) problem because of the maximization factor 
and costs are positive. p(n) is always greater than 1. 

Approximation algorithm for Travelling Salesman Problem (TSP) : 
1. The key to designing approximation algorithm is to obtain a bound on 


the optimal value (OPT). 

2. Inthe case of TSP, the minimum spanning tree gives a lower bound on 
OPT. 

3.  Thecost of aminimum spanning tree is not greater than the cost of an 
optimal tour. 


The algorithm is as follows : 
1. Find aminimum spanning tree of G. 
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2. Duplicate each edge in the minimum spanning tree to obtain a Eulerian 
graph. 

3. Find a Eulerian tour (J) of the Eulerian graph. 

4. Convert J to atour T by going through the vertices in the same order of 
T, skipping vertices that were already visited. 


PART-5 


Randomized Algorithm. 





Questions-Answers 


Long Answer Type and Medium Answer Type Questions 








Que 5.29. | Write short notes on randomized algorithms. 


OR 
Explain approximation and randomized algorithms. 


AKTU 2017-18, Marks 10 
Answer | 


Approximation algorithm : Refer Q. 5.23, Page 5-24B, Unit-5. 

Randomized algorithm : 

1. Arandomized algorithm is defined as an algorithm that is allowed to 
access a source of independent, unbiased bits and it is then allowed to 
use these random bits to influence its computation. 

2. Analgorithm is randomized if its output is determined by the input as 
well as the values produced by a random number generator. 

3. Arandomized algorithm makes use of a randomizer such as a random 
number generator. 

4. The execution time of a randomized algorithm could also vary from 
run to run for the same input. 

5. The algorithm typically uses the random bits as an auxiliary input to 
guide its behaviour in the hope of achieving good performance in the 
“average case”. 

6. Randomized algorithms are particularly useful when it faces a malicious 
attacker who deliberately tries to feed a bad input to the algorithm. 

Randomized algorithm are categorized into two classes : 

i. Las Vegas algorithm : This algorithm always produces the same 
output for the same input. The execution time of Las Vegas algorithm 
depends on the output of the randomizer. 

ii. Monte Carlo algorithm : 

a. Inthis algorithm output might differ from run to run for the same 
input. 
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b. Consider any problem for which there are only two possible 
answers, say yes and no. 

c. Ifa Monte Carlo algorithm is used to solve such a problem then 
the algorithm might give incorrect answers depending on the 
output of the randomizer. 

d. Then the requirement is that the probability of an incorrect answer 
from a Monte Carlos algorithm be low. 


Que 5.30. | Write a short note on randomized algorithm. Write its 


merits, and applications. 


Answer 


Randomized algorithm : Refer Q. 5.29, Page 5-30B, Unit-5. 
Merits: 

Simple. 

High efficiency. 

Better complexity bounds. 

Random selection of good and bad choices. 

. Cost efficient. 

pplications : 

Randomized quick sort algorithm 
Randomized minimum-cut algorithm 
Randomized algorithm for N-Queens problem 
Randomized algorithm for majority element 


Que 5.31. | Write the EUCLID’S GCD algorithm. Compute ged (99, 
78) with EXTENDED-EUCLID. 


Answer | 


Euclid’s GCD algorithm : 

The inputs a and b are arbitrary non-negative integers. 
EUCLID (a, b) { 

if (6 = = 0) 

then return a; 

else return EUCLID (0, a mod 5); } 
EXTEUCLID (a, b) { 

//returns a triple (d, x, y) such that d = gcd (a, b) 
Nd==(axx+bxYy) 

if (6 = = 0) return (a, 1, 0); 

(d,, x,,¥,) = EXTEUCLID (6, a % 6); 


| 


Pawn 


Pon 


Pp 

x=%15 

y=x,-(adivb)xy,; //div = integer division 
return (d, x, y); 


} 
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Numerical : 
Let a = 99 and b = 78 


ill. 


iv. 























In the 5 receive (a = 6, b = 3), values from the 6* call (6 = 0) has 
d, = 8, x, = 1and y, = 0. Still within the 5 call we calculate that 
d=d,=3,x=y,=Oandy=x,-(adivb)xy,=1-2x0=1. 

In the 4" receive (a = 15, b = 6), the values d, = 3, x, =O andy, =1 from 
the 5 call, then compute x = y, = 1 and 

y =x,-(adiv b)xy,=0-2x1=—-2. 

In the 3" receive (a = 21, b = 15), x =-—2 and 
y=x,-(adivb)xy,=1-(1x-2)=83. 

In the 2™! receive (a = 78, 6 = 21),x =3 and 
y=x,-(adivb)xy,=(-2)-3x3=-11. 

In the 1** receive (a = 99, b = 78), x =—11 and 
y=x,-(adivb)xy,=3-1xCl1)=14. 

The call EXTEUCLID (99, 78) return (8, — 11, 14), so ged (99, 78) = 3 and 
gcd (99, 78) = 3 = 99 x (-11) + 78 x 14. 








VERY IMPORTANT QUESTIONS 


Following questions are very important. These questions 
may be asked in your SESSIONALS as well as 


UNIVERSITY EXAMINATION. 








Q.1. What is Fast Fourier Transformation and how it works ? 
Ans: Refer Q. 5.1. 
Q. 2. Explain the following string matching algorithms : 

a. Naive string matching 

b. Rabin-Karp algorithm 

c. Knuth-Morris-Pratt algorithm 


a. Refer Q. 5.4. 
b. Refer Q. 5.8. 
c. Refer Q. 5.6. 
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Q. 3. 
Ans: 


Q. 4. 
Ans. 


Q. 5. 
Ans. 


Q.6. 


a. 
b. 
Ans. 


Ans. 


Discuss the problem classes P, NP and NP-complete. 
Refer Q. 5.11. 


Differentiate NP-complete with NP-hard. 
Refer Q. 5.15. 


Show that CUQUE NP-complete. 
Refer Q. 5.19. 


Explain the following : 
Approximation algorithm 
Randomized algorithm 


Refer Q. 5.23. 
Refer Q. 5.29. 


. Describe in detail Knuth-Morris-Pratt string matching 


algorithm. Compute the prefix function x for the pattern 
ababbabbabbababbabb when the alphabet is = = {a, b}. 
Refer Q. 5.8. 


OOO 
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Introduction 





sshbuls (2 Marks Questions) 








1.5. 


. Define the term algorithm. 
; Algorithm is a set of rules for carrying out calculation either by 


hand or ona machine. It is a finite step-by-step procedure to achieve 
arequired result. 


What are the steps needed to be followed while designing 
an algorithm ? 

Steps of designing an algorithm : 

Understanding the problem. 

Decision making on capabilities of computational devices. 
Specification of algorithm. 

Algorithm verification. 

Analysis of algorithm. 

Implementation or coding of algorithm. 


Define the following terms: 
Time efficiency 


. Space efficiency 


Time efficiency : Time efficiency of an algorithm or a program is 
the amount of time it needs to run to completion. 


. Space efficiency : Space efficiency of an algorithm or program is 


the amount of memory it needs to run to completion. 


. Give an example of worst case time complexity. 
« While searching a particular element using linear searching method, 


if desired element is placed at the end of the list then we get worst 
time complexity. 


Compare time complexity with space complexity. 


AKTU 2017-18, Marks 02 
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Ans. 
S. No. Time complexity Space complexity 
1. Time complexity is the} Space complexity is the amount 


amount of time required for 
an algorithm to complete its 
process. 


of memory needed for an 
algorithm to solve the problem. 








It is expressed using Big 
Oh(O), theta (8) and 
omega (Q) notation. 


It is expressed only using Big 
Oh(O) notation. 











1.6. 


What are the characteristics of the algorithm ? 


AKTU 2017-18, Marks 02 


Characteristics of algorithm : 

Input and output : The algorithm must accept zero or more 
inputs and must produce at least one output. 

Definiteness : Each step of algorithm must be clear and 
unambiguous. 

Effectiveness : Every step must be basic and essential. 
Finiteness : Total number of steps used in algorithm should be 
finite. 


. What do you mean by asymptotic notations ? 
; Asymptotic notation is a shorthand way to represent the fastest 


possible and slowest possible running times for an algorithm. 


. Differentiate between Big Oh(O) and theta(@) notations with 


suitable examples. 





.| O-Notation (Upper bound) 


0-Notation (Same order) 





0-notation bounds a function to 
within constant factors. 


Big-oh is formal method of 
expressing the upper bound of 
an algorithm’s running time. 





It is the measure of the longest 
amount of time it could possibly 
take for the algorithm to 
complete. 


It is the measure of the average 
amount of time it could possibly 
take for the algorithm to 
complete. 











1.9. 





For example : Time complexity 
of searching an element in 
array is O(n). 





For example : Worst case 
complexity of insertion sort is 
O(n). 


Why are asymptotic notations important ? 
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1.10. 


Ans. 


1.11. 
Ans. 


Ans. 


1.13. 


Asymptotic notations are important because : 
They give a simple characterization of algorithm efficiency. 


They allow the comparisons of the performances of various 
algorithms. 


Solve the given recurrence T(n) = 4T (n/4) +n. 


AKTU 2015-16, Marks 02 


T(n) = 4T (n/4) +n 
We will map this equation with 
T(n) = aT (n/b) + fin) 
a=4andb=4,fin)=n 
Now, nlogsa — plogst — 


i.e., case 2 of Master’s theorem is applied. Thus, resulting solution is 
T(n) = 0(n!°8¢ log n) 
= O(n log n) 


What is a heap ? What are the different types of heaps ? 
Heap: A heap is a specialized tree-based data structure that satisfies 
the heap property. 

Different types of heap are: 

Min-heap 

Binary heap 

Binomial heap 

Fibonacci heap 

Max-heap 

Radix heap 


. Justify why quick sort is better than merge sort ? 


AKTU 2015-16, Marks 02 


Theoretically both quick sort and merge sort take O (n log n) time 
and hence time taken to sort the elements remains same. However, 
quick sort is superior to merge sort in terms of space. 

Quick sort is in-place sorting algorithm where as merge sort is not 
in-place. In-place sorting means, it does not use additional storage 
space to perform sorting. In merge sort, to merge the sorted arrays 
it requires a temporary array and hence it is not in-place. 


Why counting sort is stable ? 


Counting sort is stable because numbers with the same value appear 
in the output array in the same order as they do in the input array. 


. What are the fundamental steps involved in algorithmic 


problem solving ? AKTU 2016-17, Marks 02 
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Ans. 


Ans. 


oR wONEP 


Steps involved in algorithmic problem solving are : 
Characterize the structure of optimal solution. 


Recursively define the value of an optimal solution. 


. By using bottom-up technique, compute value of optimal solution. 
. Compute an optimal solution from computed information. 


. Write recursive function to find n** Fibonacci number. 


AKTU 2016-17, Marks 02 


int fibo(int num) 

{ 

if (num == 0) 

{ 

return 0; 

} 

else if (num == 1) 
{ 

return 1; 

} 

else 

{ 
return(fibo(num — 1) + fibo(num — 2)); 
} 

} 


. Write the names of various design techniques of algorithm. 


AKTU 2016-17, Marks 02 


Various design techniques of algorithm are : 
Divide and conquer 


Greedy approach 
Dynamic programming 
Branch and bound 
Backtracking algorithm 


. Solve the following recurrence using master method : 


T(n) = 4T (n/3) + n? 


AKTU 2017-18, Marks 02 
T(n) =4T(n/3) + n? 


a=4, b=8, fln)=n? 


niosea = niogs4 = n}.261 


fn) =Q (nossa +£) 
Now, af(n/b) < c fin) 


; fin) < ¢ fin) 


col & 
3 

No) 
IA 

ie) 

= 
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c= 


Hence, T(n) = @(n?) 


cor 


1.18. Name the sorting algorithm that is most practically used 
and also write its time complexity. 


AKTU 2017-18, Marks 02 


Ans: Quick sort algorithm is most practically used in sorting. 
Time complexity of quick sort is O(n log n). 


1.19. Find the time complexity of the recurrence relation 
T(n) = n+ T(n/10) + T(7n/5) 


AKTU 2017-18, Marks 02 


Ans. 


soe ee oo 





n 7n 7n |) [49n) { 7n] ({49n) (49n) {38438n] 27 
1000) (500) (500) (250) (500) (250) (250) (125 8 





= Q (n log n) 


1.20. What is priority queue ? 


AKTU 2015-16, Marks 02 


Ans: A priority queue isa collection of elements such that each element 
has been assigned a priority. The order in which the elements are 


deleted and processed according to the following rules : 
i. An element of higher priority is processed before any element of 
lower priority. 
[A[ 1] e+ B] 2, e+—{C] 2] e+ —D/ 3 44 
Fig. 1. 
ii. Two elements with the same priority are processed according to 
the order in which they were added to queue. This can be 
implemented as linked list, or as 2D array. 
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1.21. 


Ans. 


1.22. 


Ans. 


1.23. 


Ans. 


1.24. 


Ans. 


How do you compare the performance of various 


algorithms ? AKTU 2019-20, Marks 02 


To compare the performance of various algorithms first we measure 
its performance which depends on the time taken and the size of 


the problem. For this we measure the time and space complexity of 
various algorithms which is divided into different cases such as 
worst case, average case and best case. 


Take the following list of functions and arrange them in 
ascending order of growth rate. That is, if function g(n) 
immediately follows function f(r) in your list, then it should 
be the case that f(n) is O(g(n)). 

f,@) = n?5, f,(n) = V2", f,(n) =n + 10, f,(n) = 10n, f,(7) = 100n, 


and f,(n) = n? log n AKTU 2019-20, Marks 02 


f,(n) = f,(n) = f(r) < fn) < fan) < f(r) 
Rank the following by growth rate : 
n, 2 log Jn, log n, log (log n), log? n, (log n)"°S”, 4, (3/2)", n! 


AKTU 2018-19, Marks 02 


Rank in increasing order of growth rate is given as : 


4, log n, log (log n), log” n, (log n)log n, log n, 2 log Jn ,n,n!, (3) 


What do you mean by stability of a sorting algorithm ? 


Explain its application. AKTU 2018-19, Marks 02 


Stability of a sorting algorithm : Let A be an array, and let < be 
a strict weak ordering on the elements of A. 


Sorting algorithm is stable if: 

i<j and Ali] = Al] i.e., Ali] comes before Aly]. 

Stability means that equivalent elements retain their relative 
positions, after sorting. 

Application : One application for stable sorting algorithms is sorting 
a list using a primary and secondary key. For example, suppose we 
wish to sort a hand of cards such that the suits are in the order 
clubs, diamonds, hearts, spades and within each suit, the cards are 
sorted by rank. This can be done by first sorting the cards by rank 
(using any sort), and then doing a stable sort by suit. 


OOO 
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Data Structures 








canal (2 Marks Questions) 





2.1. 


Ans. 


2.2. 


2.3. 
Ans. 
. Left rotation : When left rotation on node ‘x’ is made then its right 


2.5. 


Ans. 


What are the advantages of red-black tree over binary 
search tree ? 

The red-black tree is a self balanced tree which ensures the worst 
case time complexity as O(log N) with N numbers of nodes and 
worst case time complexity of binary search tree is O(N). Hence, 
searching of any node in RB-tree becomes efficient than the binary 
search tree. 


What is the largest possible number of internal nodes in a 
red-black tree with black height k ? 


= Consider a red-black tree with black height k. If every node is 


black, then total number of internal nodes is 2k — 1. 


Discuss the different kinds of rotations in RB-tree. 
Rotations in RB-tree : 


child becomes its parent. 
Right rotation : When right rotation on node ‘y’ is made then its 
left child becomes its parent. 


. What is the running time of RB-Delete ? 
; Running time of RB-delete is O(log n) time. 


Draw BSTs of height 2, 3 and 4 on the set of keys {10, 4, 5, 16, 
1,17, 21} 

Keys = {10, 4, 5, 16, 1, 17, 21} 

BST of height 2: 


YO @® & @ 
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BST of height 3: 


BST of height 4: 





2.6. Draw all legal B-trees of minimum degree 2 that represent 
{10, 12, 13, 14, 15}. 


Ans: Keys: 10, 12,18, 14, 15 
Minimum degree : 2 


Insert 10: 


Insert 12: 
Insert 13: 





Split, 


Insert 14: 
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Ans. 


ii. 


Iv 


2.11. 
Ans. 


Insert 15: 


Split, 





. What are the operations performed for mergeable heaps ? 


Various operations performed for mergeable heaps are : 
Make-heap ( ) ii. Insert (H, x) 


i. Minimum (4) iv. Extract-min (H) 


Union (7 p H,) 


. Explain binomial heap with properties. 


AKTU 2015-16, Marks 02 


Binomial heap is a type of data structure which keeps data sorted 
and allows insertion and deletion in amortized time. 


Properties of binomial heap : 
There are 2” nodes. 
The height of the tree is R. 


There are exactly (*) nodes at depthi fori =0,1,...., k (this is why 
U 


the tree is called a “binomial” tree). 
Root has degree k (children) and its children are B, ,, 
B, 9) «+, By from left to right. 


Discuss the application of Fibonacci heaps. 


Application of Fibonacci heaps : 
In Dijkstra’s algorithm for computing shortest path. 


In Prim’s algorithm for finding minimum spanning tree. 


What is a disjoint set ? 


; Adisjoint set is a data structure S = {S, ,.....,.S,}, or a collection of 


disjoint dynamic sets. Each set has a representative element, which 
never changes unless union with another set. 


Define binary heap. AKTU 2016-17, Marks 02 


The binary heap data structure is an array that can be viewed as a 
complete binary tree. Each node of the binary tree corresponds to 
an element of the array. The tree is completely filled on all levels 
except possibly lowest. 
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2.12. Differentiate between complete binary tree and binary tree. 


AKTU 2017-18, Marks 02 








Ans. 
S. No. Complete binary tree Binary tree 
1. | Inacomplete binary tree every | A binary tree is a tree data 


level, except possibly the last is 
completely filled, and all nodes 
in the last level are as far left 
as possible. 


structure in which each node has 
at most two children, which are 
referred to as the left child and 
the right child. 








It can have between 1 and 2’-1 
nodes at the last level h. 


It can have between 2+! and 
2'+1_ 1 nodes at the last level h. 











2.13. 


What is advantage of binary search over linear search? 
Also, state limitations of binary search. 


AKTU 2019-20, Marks 02 


Advantages of binary search over linear search : 
Input data needs to be sorted in binary search but not in linear 


search. 

Linear search does the sequential access whereas binary search 
access data randomly. 

Time complexity of linear search is O(n) where binary search has 
time complexity O(log 7). 

Limitation of binary search : 

List must be sorted. 

It is more complicated to implement and test. 


. Prove that if n > = 1, then for any n-key B-tree of height h 


and minimum degree t > = 2, h < = log, ((n + 1)/2). 


AKTU 2018-19, Marks 02 


Proof: 

The root contains at least one key. 

All other nodes contain at least ¢t — 1 keys. 

There are at least 2 nodes at depth 1, at least 2¢ nodes at depth 2, at 
least 2¢'-1 nodes at depth i and 2t’~1 nodes at depth h. 





h 
n214(t-1) > 2e** 2142 
i=1 
So t' <(n + 1)/2 as required. 
Taking log both sides we get, 
h < log, (n + 1)/2 


(PHT oy 
Digan = 


OOO 
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sahbuuhs (2 Marks Questions) 








3.6. 


Ans. 


. Describe the general method for divide and conquer. 


In divide and conquer method, a given problem is: 
Divided into smaller sub-problems. 


These sub-problems are solved independently. 


. Combining all the solutions of sub-problems into a solution of the 


large problem. 


. Give various applications of divide and conquer. 


Various applications divide and conquer strategy are: 
Binary search 


Merge sort 


i. Quick sort 
. Strassen’s matrix multiplication 


Finding maximum and minimum element 


. Describe convex hull problem. 
; There exists a set of points on a plane which is said to be convex if 


for any two points A and B in the set, the entire line segment with 
the end points at A and B belongs to the set. 


. Define activity selection problem. 
; Activity selection problem is a problem of scheduling a resource 


among several competing activity. 


. List out the disadvantages of divide and conquer algorithm. 


AKTU 2016-17, Marks 02 


Disadvantages of divide and conquer algorithm : 
Recursion is slow. 
Algorithm becomes complicated for large value of n. 


When we can say that optimization problem has overlapping 
sub-problem ? 

When a recursive algorithm revisits the same problem over and 
over again, we say that optimization problem has overlapping 
sub-problems. 
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3.7. Define greedy technique. 
Ans: Greedy technique solves problem by making the choice that seems 
best at the particular moment. 
Greedy technique works if a problem exhibit two properties : 
i. Greedy choice property ii. Optimal sub-structure 
3.8. Compare between greedy method and divide and conquer 
algorithm. 
Ans. 
S. No. Greedy algorithm Divide and Conquer 

1. It is used to obtain optimum It is used to obtain solution 
solution. to given problem. 

2. In greedy method, a set In this technique, the problem 
of feasible solution is is divided into smaller 
generated and optimum sub-problems. 
solution is picked up. 

3.9. How greedy method is used to solve the optimization 

problem ? 
Ans: In greedy technique, the solution is computed through a sequence 
of steps. In each step, the partially constructed solution is expanded. 
This process is repeated until a complete solution to the problem is 
reached. 
3.10. Give comparison between Prim’s and Kruskal’s algorithm. 
Ans. 
S. No. Prim’s algorithm Kruskal’s algorithm 
1. |It is used to obtain minimum| It is also used to obtain 
spanning tree (MST). minimum spanning tree 
(MST). 
2. | It starts to build MST from any of| It starts to build MST from 
the node. minimum weighted edge in the 
graph. 
3. | Run faster in dense graph. Run faster in sparse graph. 
3.11. Discuss principle of optimality. 
AKTU 2016-17, Marks 02 
Anis: Principle of optimality states that in an optimal sequence of decisions 
or choices, each subsequence must also be optimal. 
3.12. Define bottleneck spanning tree. 
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Ans. 


3.13. 
Ans. 


3.14. 


Ans. 


3.15. 


Ans. 


3.16. 


Ans. 


A bottleneck spanning tree T of an undirected graph Gis a spanning 
tree of G whose largest edge weight is minimum over all spanning 


trees of G. 


Can the minimum spanning tree change ? 


Yes, the spanning tree will change only in the case when some of 
the weights of edges are changed. 


Briefly explain the Prim’s algorithm. 


AKTU 2016-17, Marks 02 


First it chooses a vertex and then chooses an edge with smallest 
weight incident on that vertex. The algorithm involves following 


steps: 


Step 1 : Choose any vertex V, of G. 

Step 2 : Choose an edge e, =V,V, of Gsuch that V,# V, and e, has 
smallest weight among the edge e of G incident with V,. 

Step 3: If edges e,, és, ....... , e; have been chosen involving end 
points Vj, Vo, cere , V.,,, choose an edge e., = VV, with 


i+1? 1 
V; = {Vy we V,,,} and V,¢ LV, asivsteaess V.,,} suck that e.., has 


i+1 41 
smallest weight among the edges of G with precisely one ond in 
aoe ee Veal 


nal 
Step 4: Stop after n — 1 edges have been chosen. Otherwise goto 
step 3. 


Explain element searching techniques using divide and 


conquer approach. AKTU 2015-16, Marks 02 


Binary search is a searching technique which uses divide and 
conquer. 

In each step, the algorithm compares the input element x with the 
value of the middle element in array. If the values match, return 
the index of middle. Otherwise, ifx is less than the middle element, 
then recursively call the algorithm for left side of middle element, 
else recursively call the algorithm for right side of middle element. 


What are greedy algorithms ? Explain their characteristics ? 


AKTU 2019-20, Marks 02 


Greedy algorithms: Greedy algorithms are shortsighted in their 
approach in the sense that they take decisions on the basis of 
information at hand without worrying about the effect these 
decisions may have in the future. 

Characteristics of greedy algorithm : 

Greedy algorithms are most efficient. 

For every instance of input greedy algorithms makes a decision 
and continues to process further set of input. 

The other input values at the instance of decision are not used in 
further processing. 
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3.17. Define feasible and optimal solution. 


Ans. 


3.18. 


AKTU 2019-20, Marks 02 


Feasible solution : A feasible solution is a set of values for the 
decision variables that satisfies all of the constraints in an 
optimization problem. The set of all feasible solutions defines the 


feasible region of the problem. 


Optimal solution : An optimal solution is a feasible solution where 
the objective function reaches its maximum (or minimum) value. 


Compare adjacency matrix and linked adjacency lists 
representation of graph with suitable example/diagram. 


AKTU 2018-19, Marks 02 








Ans. 
S.No. Adjacency matrix Linked adjacency list 
1. An adjacency matrix is a| Linked adjacency list is a 


square matrix used to 
represent a finite graph. 


collection of unordered lists used 
to represent a finite graph. 














2. The elements of the matrix | Each list describes the set of 
indicate whether pairs of | adjacent vertices in the graph. 
vertices are adjacent or not in 
the graph. 

3. Space complexity in the worst | Space complexity in the worst 


case is O(|V|?). 





case is O(|V|+|E|). 








For example : Consider the graph : 


Using adjacency matrix : 


0 


rw Nr O 
PrP Oo Cor oO 


1234 


oo rF CO rH 
or OF Oo 
ese oO fF OC 
or COC F&F 





Pal 
[Oo] /+ 
[i] 7 
fol 7] 
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UNIT 


Dynamic Programming, 
Backtracking and 
Branch and Bound 

(2 Marks Questions) 











. Describe dynamic programming. 
; Dynamic programming is a technique for solving problems with 


overlapping subproblems. 


. Give two differences between dynamic programming and 


divide and conquer techniques. 





Dynamic programming 


In dynamic programming, many 
decision sequences are generated 
and all the overlapping sub- 
instances are considered. 


Divide and conquer 


The problem is divided into 
small subproblems. These 
subproblems are solved 
independently. 








In dynamic computing, duplication 
in solutions is avoided totally. 





In this method, duplications in 
subsolutions are neglected. 





4.3. 


Ans. 


Explain dynamic programming. How it is different from 


greedy approach ? 
OR 


AKTU 2015-16, Marks 02 


Differentiate between greedy technique and dynamic 


programming. 


AKTU 2017-18, Marks 02 


Dynamic programming is a technique for solving problems with 


overlapping subproblems. 
In dynamic programming, problems 


are solved by using divide and 


conquer method but in greedy approach problem are solved by 
making the choice that seems best at the particular moment. 


Difference: 





S. No. 


Dynamic programming 


Greedy method 











Dynamic programming can 
be thought of as ‘smart’ 
recursion. It often requires 
one to break down a problem 
into smaller components that 
can be cached. 





A greedy algorithm is one that at 
a given point in time makes a local 
optimization. 
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Greedy algorithms have a local 
choice of the subproblem that will 
lead to an optimal answer. 


Dynamic programming 
would solve all dependent 
subproblems and then select 
one that would lead to an 
optimal solution. 











4.4, 


Ans. 


4.5. 
Ans. 


State the single source shortest path. 


AKTU 2017-18, Marks 02 


Single source shortest path problem states that in a given graph 
G = (V, E) we can find a shortest path from given source vertex 
s e V to every vertex vu € V. 


What is the purpose of Floyd-Warshall’s algorithm ? 


The purpose of Floyd-Warshall’s algorithm is to find the shortest 
path between all pairs of vertices in a graph. It uses a number of 


matrices of size n x n where n is the number of vertices. 


. What are the constraints used for solving the problem in 


backtracking algorithm ? 


; There are two types of constraints used to solve the problem 


in backtracking : 
Explicit constraints 
Implicit constraints 


. Write the major advantage of backtracking algorithm. 
- The major advantage of backtracking algorithm is that we can 


realize the fact that the partial vector generated does not lead to an 
optimal solution. In such a situation that vector can be ignored. 











4.8. State the difference between backtracking and branch and 
bound. AKTU 2015-16, 2016-17, 2017-18; Marks 02 
Ans. 
S. No. Backtracking Branch and bound 
1. | Solution for backtracking is | In this method, it is not necessary 
traced using depth first| to use depth first search for 
search. obtaining the solution, even the 
breadth first search, best first 
search can be applied. 
2. | Typically decision problems | Typically optimization problems can 
can be_ solved’ using| be solved using branch and bound. 
backtracking. 
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4.9. 


Ans. 


4.10. 
Ans. 


4,11. 
Ans. 


4,12. 
Ans. 


4.13. 


4.14, 


Ans. 


What is the running time complexity of 8-Queens problem ? 


AKTU 2016-17, Marks 02 


The running time complexity of 8-Queens problem is O(P(n)n!) 
where P(7) is polynomial in n. 


Define graph colouring. AKTU 2017-18, Marks 02 


Graph colouring is a problem of colouring each vertex in graph in 
such a way that no two adjacent vertices have same colour and 
m-colours are used. 


What is optimal colouring ? 

If the degree of given graph is d then we colour it with 
d+1colours. The least number of colours needed to colour the 
graph is called its chromatic number. Such type of colouring is 
called optimal colouring. 


What is Travelling Salesman Problem (TSP) ? 

Travelling salesman problem is a problem in which a salesman 
visits ‘m’ cities, in a way that all cities must be visited at once and in 
the end, he returns to the city from where he started, with minimum 
cost. 


Mention the three common techniques used in amortized 
analysis and write the characteristics of one of its 
technique. 

Three common techniques used in amortized analysis are : 
Aggregate method 

Accounting method 


. Potential method 


Characteristics of aggregate method are : 
The amortized cost is T(n)/n per operation. 
It gives the average performance of each operation in the worst case. 


Find out Hamiltonian cycles in complete graph having ‘n’ 


vertices. AKTU 2015-16, Marks 02 


The answer depends on how we think that two Hamiltonian cycles 
are equal. Take K,K, as example. Let’s call its vertices 1,, 2, and 3,. 


Then do we consider 1 2> 31, >2>3-— 1same as 2>3—> 
1>2,33>1>2? Ifyes,1> 2531, >2>3- 1isthe same 
as 2>3>1>2,>3—1- 2, whichis the same as 3 >1>42—> 
3, > 1> 2 3in K,K,. Then we will have two Hamiltonian cycles 
152538 >1,>2>38>1and1>53>5251,>53>2-51. 
Moreover, if we consider 1 >2>3—>1,>2>3—1and1>3> 
2—>1,>3-— 2 — 1 being the same because the second one is 
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4.15. 


obtained by reversing direction the first one, then we have only 
one Hamiltonian cycle in K,K,. 
For general K,K,, it’s the same. 1 > 2>...>n>1,>32->...> 
n— listhe same as2—>... >n>1>2,>...>n>1- 2is the 
same as...n>1>52->5...5nn>1>52-...-n. Andthe1>2 
>... 9nN1,32>..9n>1landlona...>92>1,9n> 
... > 2 — 1 being the same because the second one is obtained by 
reversing direction the first one. So, we have altogether 12(n—- 1)! 
12(n — 1)! Hamiltonian cycles in K,K,,. 

















Find the subsets of sum of following problem. Given total 
elements are (S) = {4, 2, 7, 6, 8} and maximum SUM is (X) = 8. 


AKTU 2015-16, Marks 02 


Ans. 
Initially subset Sum(x) =8 
= {s} 
4 4 Add next element 
4,2 6.6<8 Add next element 
4,2,7 13 Sum exceeds X = 8 
Hence backtrack 
4,2,6 12 Sum exceeds X = 8 
.. Backtrack 
4,2,8 14 Sum exceeds X = 8 
.. Not feasible 
Hence backtrack 
4,2 Add next element 
4,7 11 Backtrack 
2.7 9 Backtrack 
2,6 8 Solution obtained as 
sum = 8=X. 
Also 
2 Backtrack 
8 Backtrack and add element 
8 Solution obtained as 
sum = 8=X 
4.16. Explain application of graph colouring problem. 
Ans: Application of graph colouring problem : 
1. Sudoku: Sudoku is a variation of graph colouring problem where 


every cell represents a vertex. There is an edge between two vertices 
if they are in same row or same column or same block. 


. Register allocation : In compiler optimization, register allocation 


is the process of assigning a large number of target program variables 
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4.17. 


Ans. 


onto asmall number of CPU registers. This problem is also a graph 
colouring problem. 

Bipartite graphs : We can check if a graph is bipartite or not by 
colouring the graph using two colours. If a given graph is 
2-colourable, then it is bipartite, otherwise not. 

Map colouring : Geographical maps of countries or states where 
no two adjacent cities cannot be assigned same colour. 


Define principle of optimality. When and how dynamic 


programming is applicable ? AKTU 2018-19, Marks 02 


Principle of optimality : Refer Q. 3.11, Page SQ-12B, Unit-3, 
Two Marks Questions. 

Dynamic programming is mainly applicable where the solution of 
one sub-problem is needed repeatedly. In this procedure, the 
solutions of sub-problems are stored in a table, so that there is no 
need to re-compute the sub-problems and can be directly accessed 
from the table if required. 


OOO 
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UNIT 


Selected Topics 
(2 Marks Questions) 











5.1. 
Ans. 


Define Fast Fourier Transformation (FFT). 

The Fast Fourier Transform (FFT) is a algorithm that computes a 
Discrete Fourier Transform (DFT) of n-length vector in O(n log n) 
time. In the FFT algorithm, we apply the divide and conquer 
approach to polynomial evaluation by observing that if n is even, 
we can divide a degree (n — 1) polynomial. 























5.2. Discuss the term string matching. 

Ans: String matching algorithms, are an important class of string 
algorithms that try to find a place where one or several strings (also 
called patterns) are found within a larger string or text. 

5.3. Write about Knuth-Morris-Pratt algorithm. 

Ans: It is the first linear time string matching algorithm. In this, we have 
to examine all the characters in the text and pattern at least once. 
The running time is O(n + m). 

5.4. Differentiate between decision problem and optimization 
problem. 

Ans. 

S. No. Decision problem Optimization problem 
i. | Any problem for which | Any problem that involves the 
answer is either yes or no | identification of optimal cost is called 
is called decision problem. | optimization problem. 

ii. | The algorithm for decision | Typically optimization problems can 
problem is called decision | be solved using branch and bound. 
algorithm. 

5.5. Define P, NP and NP-complete in decision problems. 

AKTU 2015-16, 2016-17; Marks 02 

Ans: P-polynomial time : These problems can be solved in polynomial 


time, which take time like O(n), O(n”), O(n°) like finding maximum 
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5.6. 
Ans. 


5.11. 


wn 


element in an array or to check whether a string is palindrome or 
not are P problems. 

Non deterministic polynomial time : These problem cannot be 
solved in polynomial time like TSP (Travelling Salesman Problem) 
or subset sum are NP problem. 

But NP problems are checkable in polynomial time means that 
given a solution of a problem, we can check that whether the 
solution is correct or not in polynomial time. 

NP-complete : The group of problems which are both in NP and 
NP-hard are known as NP-complete problem. 


When a language is said to be NP-complete and NP-hard ? 
A language L c {0, 1}* is NP-complete, if it satisfies the following 
two properties : 

Le NPand 

For every L' ¢ NP, L'<PL 

If alanguage L satisfies property (iz), but not necessarily property 
(i), we say that L is NP-hard. 


. Describe satisfiability. 
; A given boolean formula is satisfiable if there is a way to assign 


truth values (0 or 1) to the variable such that the final result is 1. 


. Define circuit satisfiability. 
: Acombinational circuit is called circuit satisfiable if for set of inputs 


applied, output of this circuit should always be one. 


. Name some NP-complete problems. 


NP-complete problems are: 
The 0/1 knapsack problem 
Hamiltonian cycle 


. Travelling salesman problem 


. Define vertex cover. 
; A vertex cover to an undirected graph G = (V, E) is a subset of 


V' cVsuch that if edge (wu, v) e Gthen u € V’ orv € V' (or both). This 
optimal vertex cover is the optimization version of an 
NP-complete problem but it is not too hard to find a vertex cover 
that is near optimal. 


Name any three problems that cannot be solved by 
polynomial time algorithm. 


; Three problems that cannot be solved by polynomial time 


algorithm are : 
Halting problem 
Decision problem 
Optimization problem 
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5.12. 


Ans. 


5.18. 


What are polynomial-time solvable and polynomial-time 
verifiable algorithms ? 

Polynomial-time solvable algorithm : 

An algorithm is said to be solvable in polynomial time if the number 
of steps required to complete the algorithm for a given input is 
O(n*) for some non-negative integer k where n is the complexity of 
input. 

Polynomial-time verifiable algorithm : A polynomial-time 
algorithms A is said to be polynomial time verifiable if it has following 
properties : 

The input to A consists of an instance J of X(X is a decision problem) 
and a string s such that the length of s is bounded by some 
polynomials in the size of I. 

The output of A is either yes or no. 

IfJis a negative instance of X. Then the output of A is “no’ regardless 
of the value of s. 

If J is a positive instance of X, then there is at least one choice of s 
for which A output “yes”. 


. List three problems that have polynomial time algorithm. 


Problems that have polynomial time algorithm are : 
Binary search 


Evaluation of polynomial 


. Sorting a list 


. List any two approximation algorithms. 


Two approximation algorithms are : 
Nearest neighbour algorithm 
Greedy algorithm 


. Mention the types of randomized algorithms. 


Two types of randomized algorithms are : 
Las Vegas algorithms 
Monte Carlo algorithm 


. Describe the advantages of randomized algorithms. 


Advantages of randomized algorithms are : 

These algorithms are simple to implement. 

These algorithms are many times efficient than traditional 
algorithms. 


. What do you mean by clique ? 
- A clique in an undirected graph G = (V, E) is a subset 


V' cV of vertices, each pair of which is connected by an edge in E. 
CLIQUE = {(G, R): Gis a graph with a clique of size R}. 


Explain applications of FFT. AKTU 2019-20, Marks 02 
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5.20. 


Ans. 


Ronee 


Application of Fast Fourier Transform : 


. Signal processing. 

. Image processing. 

. Fast multiplication of large integers. 

. Solving Poisson’s equation nearly optimally. 


. What do you mean by polynomial time reduction ? 


AKTU 2019-20, Marks 02 


: A polynomial time reduction is a method for solving one problem 


using another. For example, if a hypothetical subroutine solving 
the second problem exists, then the first problem can be solved by 
transforming or reducing it to inputs for the second problem and 
calling the subroutine one or more times. 


What are approximation algorithms ? What is meant by 
p(n) approximation algorithms ? 


AKTU 2018-19, Marks 02 


Approximation algorithm : An approximation algorithm is a 
way of dealing with NP-completeness for optimization problem. 


This technique does not guarantee the best solution. 

p(n) approximation algorithm : A is a p(n) approximate 
algorithm if and only if for every instance of size n, the algorithm 
achieves an approximation ratio of p(n). It is applied to both 
maximization (0 < C(i) < C*(z)) and minimization (0 < C* (Z) < C(a)) 
problem because of the maximization factor and costs are positive. 
p(n) is always greater than 1. 


OOO 
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B. Tech. 
(SEM. V) ODD SEMESTER THEORY 
EXAMINATION, 2015-16 


DESIGN AND ANALYSIS OF ALGORITHMS 


Time : 3 Hours Max. Marks : 100 


Note: 


SECTION -A 


Note : Attempt all parts. All parts carry equal marks. Write answer 
of each part in short. (2x 10 = 20) 


. Justify why quick sort is better than merge sort ? 


What is priority queue ? 


Find out Hamiltonian cycles in complete graph having ‘n’ 
vertices. 


Explain binomial heap with properties. 


Explain element searching techniques using divide and 
conquer approach. 


Find the subsets of sum of following problem. Given total 
elements are (S) = {4, 2, 7, 6, 8} and maximum SUM is (X) = 8. 


Explain dynamic programming. How it is different from 
greedy approach ? 


Solve the given recurrence T(n) = 4T (n/4) +n. 


Differentiate between backtracking and branch and bound 
programming approach. 


. Explain the P, NP and NP-complete in decision problems. 


SECTION - B 


Attempt any five questions from this section : (10 x5 =50) 


. Explain insertion in red-black tree. Show steps for inserting 


1, 2, 3, 4, 5, 6, 7, 8 and 9 into empty RB-tree. 
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3. 


11. 


Discuss knapsack problem with respect to dynamic 
programming approach. Find the optimal solution for 
given problem, w (weight set) = {5, 10, 15, 20} and W 
(Knapsack size) = 25 and v = {50, 60, 120, 100}. 


What is heap sort ? Apply heap sort algorithm for sorting 
1, 2, 3, 4, 5, 6, 7, 8, 9, 10. Also deduce time complexity of heap 
sort. 


Explain B-tree and insert elements B, Q, L, F into B-tree 
Fig. 1 then apply deletion of elements F, M, G, D, B on 
resulting B-tree. 





Write an algorithm for solving N-Queens problem. Show 
the solution of 4-Queens problem using backtracking 
approach. 


Explain greedy single source shortest path algorithm with 
example. 


What is string matching algorithm ? Explain Rabin-Karp 
method with examples. 


Explain approximation algorithms with suitable examples. 


SECTION - C 


: Attempt any two questions from this section : (15 x 2 =30) 


. What is Fibonacci heap ? Explain CONSOLIDATE operation 


with suitable example for Fibonacci heap. 


What is minimum spanning tree ? Explain Prim’s algorithm 
and find MST of graph Fig. 2. 
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12. Explain TSP (Travelling Salesman) problem with example. 
Write an approach to solve TSP problem. 


OOO 
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lia. 
Ans. 


Ans. 


Ans. 


SOLUTION OF PAPER (2015-16) 
SECTION -A 


Note: Attempt all parts. All parts carry equal marks. Write answer 
of each part in short. (2x 10 = 20) 


Justify why quick sort is better than merge sort ? 
Theoretically both quick sort and merge sort take O (n log n) time 
and hence time taken to sort the elements remains same. However, 
quick sort is superior to merge sort in terms of space. 

Quick sort is in-place sorting algorithm where as merge sort is not 
in-place. In-place sorting means, it does not use additional storage 
space to perform sorting. In merge sort, to merge the sorted arrays 
it requires a temporary array and hence it is not in-place. 


What is priority queue ? 

A priority queue is a collection of elements such that each element 
has been assigned a priority. The order in which the elements are 
deleted and processed according to the following rules : 

An element of higher priority is processed before any element of 
lower priority. 

Two elements with the same priority are processed according to 
the order in which they were added to queue. This can be 
implemented as linked list, or as 2D array. 


Find out Hamiltonian cycles in complete graph having ‘n’ 
vertices. 
The answer depends on how we think that two Hamiltonian cycles 
are equal. Take K,K, as example. Let’s call its vertices 1,, 2, and 3,. 
Then do we consider 1 > 2>3—>1,>23- 1same as 2>3—> 
1>2,>3>51>2?Ifyes,1>2 431, >23- Listhe same 
as 2>3>1>2,>3—1- 2, whichis the same as 3 > 152 
3, > 1> 2 3 in K,k,. Then we will have two Hamiltonian cycles 
15253 51,>2>38>1and1>3>5251,53>2>51. 
Moreover, if we consider 1 >2>3—>1,>243—1and1>3> 
21,7 3-— 2 — 1 being the same because the second one is 
obtained by reversing direction the first one, then we have only 
one Hamiltonian cycle in K,K,. 
For general K,K,, it’s the same. 1 > 2—>...>n>1,>32->...> 
n-— listhe same as2—>...>n>1>2,>...>n>1- 2is the 
same as..n>1>52->...9nn>1>52-...>n. Andthe1>2 
>... 9n1,392>..9n>1andlon...92>51,3n> 
... > 2— 1 being the same because the second one is obtained by 
reversing direction the first one. So, we have altogether 12(n— 1)! 
12(n— 1)! Hamiltonian cycles in K,K . 


non 
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d. Explain binomial heap with properties. 
Ans: Binomial heap is a type of data structure which keeps data sorted 
and allows insertion and deletion in amortized time. 
Properties of binomial heap : 
i. There are 2” nodes. 
ii. The height of the tree is k. 
iii. There are exactly (*) nodes at depthi fori =0,1,...., 2 (this is why 
L 
the tree is called a “binomial” tree). 
iv Root has degree k (children) and its children are B, ,, 
B, 9) +++) By from left to right. 
e. Explain element searching techniques using divide and 
conquer approach. 
Ans: Binary search is a searching technique which uses divide and 
conquer. 
In each step, the algorithm compares the input element x with the 
value of the middle element in array. If the values match, return 
the index of middle. Otherwise, ifx is less than the middle element, 
then recursively call the algorithm for left side of middle element, 
else recursively call the algorithm for right side of middle element. 
f. Find the subsets of sum of following problem. Given total 
elements are (S) = {4, 2, 7, 6, 8} and maximum SUM is (X) = 8. 
Ans. 
Initially subset Sum(x) =8 
= {s} 
4 4 Add next element 
4,2 6.6<8 Add next element 
4,2,7 13 Sum exceeds X = 8 
Hence backtrack 
4,2,6 12 Sum exceeds X = 8 
.. Backtrack 
4,2,8 14 Sum exceeds X = 8 
. Not feasible 
Hence backtrack 
4,2 Add next element 
4,7 11 Backtrack 
27 9 Backtrack 
2,6 8 Solution obtained as 
sum = 8=X. 
Also 
2 Backtrack 
8 Backtrack and add element 
8 Solution obtained as 


sum = 8=X 
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g. Explain dynamic programming. How it is different from 
greedy approach ? 

Dynamic programming is a technique for solving problems with 
overlapping subproblems. 

In dynamic programming, problems are solved by using divide and 
conquer method but in greedy approach problem are solved by 


Ans. 


making the choice that seems best at the particular moment. 


Difference: 





Dynamic programming 


1. | Dynamic programming can 
be thought of as ‘smart’ 
recursion. It often requires 
one to break down a problem 
into smaller components that 
can be cached. 


Greedy method 


A greedy algorithm is one that at 
a given point in time makes a local 
optimization. 








2. |Dynamic programming 
would solve all dependent 
subproblems and then select 
one that would lead to an 
optimal solution. 





Greedy algorithms have a local 
choice of the subproblem that will 
lead to an optimal answer. 





h. Solve the given recurrence T(n) = 4T (n/4) +n. 


Ans: T(n) =4T (n/4)+n 


We will map this equation with 
T(n) = aT (n/b) + fin) 
a=4andb=4,fin)=n 


Now, nies = ploes4 = n 


i.e., case 2 of Master’s theorem is applied. Thus, resulting solution is 
T(n) = 0(n"8 log n) 


= O(n log n) 


i. Differentiate between backtracking and branch and bound 


programming approach. 


Backtracking 





Solution for backtracking is 
traced using depth first 
search. 


Branch and bound 


In this method, it is not necessary 
to use depth first search for 
obtaining the solution, even the 
breadth first search, best first 
search can be applied. 








2. | Typically decision problems 
can be solved using 
backtracking. 





Typically optimization problems can 
be solved using branch and bound. 
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Ans. 


Note: 


CANO POnNe 


PwON Pr 


Explain the P, NP and NP-complete in decision problems. 
P-polynomial time : These problems can be solved in polynomial 
time, which take time like O(n), O(n?), O(n?) like finding maximum 
element in an array or to check whether a string is palindrome or 
not are P problems. 

Non deterministic polynomial time : These problem cannot be 
solved in polynomial time like TSP (Travelling Salesman Problem) 
or subset sum are NP problem. 

But NP problems are checkable in polynomial time means that 
given a solution of a problem, we can check that whether the 
solution is correct or not in polynomial time. 

NP-complete : The group of problems which are both in NP and 
NP-hard are known as NP-complete problem. 


SECTION - B 


Attempt any five questions from this section : (10 x 5 = 50) 


. Explain insertion in red-black tree. Show steps for inserting 


1, 2, 3, 4, 5, 6, 7, 8 and 9 into empty RB-tree. 
Insertion : 
We begin by adding the node as we do in a simple binary search 
tree and colouring it red. 
RB-INSERT(T, z) 
y < nil [7] 
x < root [T] 
while x #nil [T] 

doy<x 

if keylz] < key [x] 

then x < left [x] 

else x < right [x] 
pkl<y 
if y = nil [T] 

then root [T] <z 

else if key [z] < keyly] 

then left [y]< z 

else right ly] <z 
left [z] < nil[T] 
right [z] < nil[T] 
colour [z] < RED 
RB-INSERT-FIXUP(7, z) 
Now, for any colour violation, RB-INSERT-FIXUP procedure is 
used. 
RB-INSERT-FIXUP(T7, z) 
while colour [p[z]] = RED 

do if plz] = left{p [p [z]]] 

then y < right[p [p [z]]] 
if colour[y] = RED 
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then colour[p [z]] < BLACK = case 1 
colourly] < BLACK = case 1 
colour|p [p [z]]]<- RED = case 1 
z<p |p [zll 

else if z = right[p[z]] 
then z < plz] 
LEFT-ROTATE(T, z) 
colour|p[z]] < BLACK 
colour |p[p[z]]] < RED 
RIGHT-ROTATE(Y, pl[plzl]) 


=> case 1 


=> case 2 
=> case 2 
=> case 3 
=> case 3 
=> case 3 


else (same as then clause with “right” and “left”exchanged) 


colour[root[T]] <- BLACK 
Numerical : 


B 
Insert 1: @) 
B 


Insert 2: Vos 


Insert 3: 


B B 
R Case 2 ane 
eS, R R R 


Insert 4: 
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Insert 6: 


(2) 
@) 
R 





Insert 7: 





3. Discuss knapsack problem with respect to dynamic 
programming approach. Find the optimal solution for 
given problem, w (weight set) = {5, 10, 15, 20} and W 
(Knapsack size) = 25 and v = {50, 60, 120, 100}. 

Ans: Knapsack problem with respect to dynamic programming 
approach : 
Dynamic 0/1-knapsack(v, w, n, W): 
1. for (w = 0 to W) V[0, w] = 0 
2. for (i= 1 ton) 
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3 
4 
5. 
6 
7 


for (w = 0 to W) 
if (w[i] < w) then 
Vii, w] = max{V[i — 1, w], v[i] + Vii — 1, w — w{[i]]}; 
else V[i, w] = Vii — 1, wl]; 
return V[n, W]; 


Now, as we know that V [n, W] is the total value of selected items, 
the can be placed in the knapsack. Following steps are used 
repeatedly to select actual knapsack item. 


Let, i=n and k= Wthen 
while (1 > 0 and k > 0) 
{ 
if (V[i, k] Vii — 1, k]) then 
mark i'4 item as in knapsack 
i=i-landk=k-vw,// selection of i** item 
else 
i=i-1 //donot select i** item 


} 











Numerical : 
w = {5, 10, 15, 20} 
W = 25 
v = {50, 60, 120, 100} 
Initially, 
Item Ww; v; 
I, 5 50 
L, 10 60 
I, 15 120 
[, 20 100 














Taking value per weight ratio, i.e., p, = v,/w; 











Item Ww; U; p, =v; 
I, 5 50 10 
L, 10 60 6 
I, 15 120 8 
I, 20 100 5 

















Now, arrange the value of p, in decreasing order. 











Design and Analysis of Algorithms SP-11 B (CS/IT-Sem-5) 

















Item Ww; U; p,=0/u; 
I, 5 50 10 
I, 15 120 8 
L, 10 60 6 
I, 20 100 5 

















Now, fill the knapsack according to decreasing value of p,. 

First we choose item J, whose weight is 5, then choose item J, whose 
weight is 15. Now the total weight in knapsack is 5 + 15 = 20. Now, next 
item is J, and its weight is 10, but we want only 5. So, we choose fractional 
part of it, i.e., 





The value of fractional part of I, is, 
_ 60 
10 

Thus, the maximum value is, 
= 50+ 120+ 3= 200 


x 5= 30 


4, What is heap sort ? Apply heap sort algorithm for sorting 
1, 2, 3, 4, 5, 6, 7, 8, 9, 10. Also deduce time complexity of heap 
sort. 
Ans: Heap sort: 

1. Heap sort is a comparison based sorting technique based on binary 

heap data structure. 

2. Heap sort finds the largest element and puts it at the end of array, 
then the second largest item is found and this process is repeated 
for all other elements. 

MAX-HEAPIFY (A, i): 

i < left [7] 

r < right [7] 

if 1 < heap-size [A] and A[/] > Ali] 
then largest < 1 

else largest <i 

if r < heap-size [A] and A[r] >A [largest] 
then largest <r 

if largest #1 

then exchange A[i] <> A[largest] 
MAX-HEAPIFY [A, largest] 


SHBANHOAPWNE 


a 
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Ans. 


oP 


HEAP-SORT(A): 
BUILD-MAX-HEAP (A) 
for i < length [A] down to 2 
do exchange A[1] «+ Alz] 

heap-size [A] < heap-size [A] — 1 

MAX-HEAPIFY (A, 1) 
BUILD-MAX-HEAP (A) 
heap-size (A) < length [A] 
for i < (length [A]/2) down to 1 do 
MAX-HEAPIFY (A, i) 
We can build a heap from an unordered array in linear time. 
Average case and worst case complexity : 
We have seen that the running time of BUILD-HEAP is O(n). 
The heap sort algorithm makes a call to BUILD-HEAP for creating 
a (max) heap, which will take O(n) time and each of the (n — 1) 
calls to MAX-HEAPIFY to fix up the new heap (which is created 
after exchanging the root and by decreasing the heap size). 
We know ‘MAX-HEAPIFY’ takes time O(log 7). 
Thus the total running time for the heap sort is O(n log n). 
Numerical : Since the given problem is already in sorted form. 
So, there is no need to apply any procedure on given problem. 


Explain B-tree and insert elements B, Q, L, F into B-tree 
Fig. 1 then apply deletion of elements F, M, G, D, B on 
resulting B-tree. 





B-tree : 

A B-tree of order m is an m-ary search tree with the following 
properties : 

The root is either leaf or has atleast two children. 

Each node, except for the root and the leaves, has between m/2 
and m children. 

Each path from the root to a leaf has the same length. 

The root, each internal node and each leaf is typically a disk block. 
Each internal node has upto (m — 1) key values and upto m children. 
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Numerical : 
Insertion : 
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Insert Q: 





Deletion: 
Delete F: 
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Delete G: 





Rone 


. Write an algorithm for solving N-Queens problem. Show 


the solution of 4-Queens problem using backtracking 
approach. 


. In N-Queens problem, the idea is to place queens one by one in 


different columns, starting from the leftmost column. 


. When we place a queen in a column, we check for clashes with 


already placed queens. 


. Inthe current column, if we find a row for which there is no clash, 


we mark this row and column as part of the solution. 


. Ifwe do not find such a row due to clashes then we backtrack and 


return false. 

Algorithm for N-Queens problem : 

N-Queens are to be placed on an n x n chessboard so that no two 
attack i.e., no two Queens are on the same row, column or diagonal. 
PLACE (k, i) 


. forj<1tok—-1 
. do if (x(j) =i) or Abs (x[j] — i) = (Abs ( — R)) 


then return false 


. return true 


Place (k, i) returns true if a queen can be placed in the k row and 
ith column otherwise return false. 

x[] is a global array whose first k — 1 values have been set. Abs(r) 
returns the absolute value of r. 
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oP ONE 


N-Queens (k, n) 
fori<lton 

do if PLACE (2, i) 

then x[k] <i 

if k =n, then print x[1.... N] 
else N-Queens (k + 1, n) 
[Note : For 8-Queen problem put n = 8 in the algorithm.] 
4-Queens problem : 
Suppose we have 4 x 4 chessboard with 4-queens each to be placed 
in non-attacking position. 


Rone 


Fig. 2. 
Now, we will place each queen on a different row such that no two 
queens attack each other. 
We place the queenq, in the very first accept position (1, 1). 
Now if we place queen q, in column 1 and 2 then the dead end is 
encountered. 
Thus, the first acceptable position for queen q, is column 37.e., (2, 3) 
but then no position is left for placing queen q, safely. So, we 
backtrack one step and place the queen q, in (2, 4). 
Now, we obtain the position for placing queen q, which is (3, 2). But 
later this position lead to dead end and no place is found where 
queen q, can be placed safely. 

4 


3 
Be 
cee 
‘ed | 


1 2 
T] 


bo 





Fig. 3. 
Then we have to backtrack till queen q, and place it to (1, 2) and 
then all the other queens are placed safely by moving queen q, to 
(2, 4), queen q, to (3, 1) and queen q, to (4, 3) i.e., we get the solution 
< 2,4, 1, 38>. This is one possible solution for 4-queens problem. 
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Fig. 4. 





8. For other possible solution the whole method is repeated for all 


10. 


partial solutions. The other solution for 4-queens problem is <3, 1, 


1 2 3 
| [ul | 
fet | 


ry 


4 








Fig. 5. 
9. Now, the implicit tree for 4-queen for solution <2, 4, 1, 3> is as 


Fig. 6 shows the complete state space for 4-queens problem. But we 
can use backtracking method to generate the necessary node and 
stop if next node violates the rule i.e., if two queens are attacking. 





Fig. 6. 
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7. 


Ans. 
1. 


=o 





Explain greedy single source shortest path algorithm with 
example. 


Dijkstra’s algorithm, is a greedy algorithm that solves the single 
source shortest path problem for a directed graph G = (V, £) with 
non-negative edge weights, i.e., we assume that w(u, v) > 0 each 
edge (u,v) € E. 

Dijkstra’s algorithm maintains a set S of vertices whose final 
shortest path weights from the source s have already been 
determined. 

That is, for all vertices v <¢ S, we have d[v] = Os, v). 

The algorithm repeatedly selects the vertex uw ¢ V—S with the 
minimum shortest path estimate, inserts u into S, and relaxes all 
edges leaving w. 

We maintain a priority queue Q that contains all the vertices in 
vu —s, keyed by their d values. 

Graph G is represented by adjacency list. 

Dijkstra’s always chooses the “lightest or “closest” vertex in V—S 
to insert into set S that it uses as a greedy strategy. 

For example : 

Initialize: 


oO 50 9 S: {1} 


i) 
(—) 
to 
S 
8 
8 
8 
8 








All edges leaving (1): 
10 00 


50 S:{1 
Q » | {1} 
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Extract min(2): 


[10] 60 30 100 








20 60 30 100 
60 100 
50 
100 «(8° 30 
Extract min(3): 
10 gy S: {1, 2, 4, 3} 
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All edges leaving (3) : 


S: {1, 2, 4, 3,} 
Q 2 38 4 «5 


a 

[0] @ © 0 © 

[10] «© 30 100 
60 [30] 100 


60 





S: {1, 2, 4, 3, 5} 
3 4 5 
0 0 00 


«2 30 100 


60 100 





8. What is string matching algorithm ? Explain Rabin-Karp 

method with examples. 

Ans: String matching algorithm : 
String matching is a process of finding one or more occurrences of 
a pattern ina text. 
String matching problem : 
Given a text array T[1..n] of n character and a pattern array P[1.. 
m|] of m characters. 
The problem is to find an integer s, called valid shift where 0 <s <n 
—mandT[s+1....s+m]=P[1... ml. 
We further assume that the elements of P and T are characters 
drawn from a finite alphabet = such as (0, 1} or {A, B, ... Z, a, 6,..., 
zh. 
The Rabin-Karp algorithm : 
The Rabin-Karp algorithm states that if two strings are equal, their 
hash values are also equal. This also uses elementary number- 
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WON S oP ON 


theoretic notions such as the equivalence of two numbers module 
a third. 

Rabin-Karp-Matcher (T, P, d, q) 
n < length [T] 

m < length [P] 

h<d™modgq 

p< 

t,< 0 

fori<-_ltom 

do p « (dp + p [i]) modqg 

ty < (dt, + Tli]) mod q 
fors<0ton—m 

do if p =t, 


. thenifp [1....m] =T[s + 1...... s+m] 


then “pattern occurs with shift” s 


. ifs<n-—m 


then t, , ,< (d(t,— T [s + 1] h) + Tls +m +1]) mod q 

Example of Rabin-Karp method : Working modulo qg = 11, how 
many spurious hits does the Rabin-Karp matcher encounter in the 
text T = 3141592653589793 when looking for the pattern p = 26 
Given, p=26andq=11 

Now we divide 26 by 11i.e., 

Remainder is 4 and m = 2. 

We know m denotes the length of p. 

Tis} 4] 1f5]9l2f6l5i3l5islol7iol 3, | 
LEW 
Now we divide 31 by 11, and get remainder is 9. 

Similarly, 14 by 11 and get remainder is 3. 

So, continue this step till last 7.e., 93 is divided by 11 and get remainder 
is 5. After that we will store all remainder in a table. 


}9 | s{s]4}a[4]4]roj9|2}s}i}o]2]s| 


Now we find valid matching. 








hit 
The number of spurious hits is 3. 


9. Explain approximation algorithms with suitable examples. 


Approximation algorithm : 
An approximation algorithm is a way of dealing with NP- 


completeness for optimization problem. This technique does not 
guarantee the best solution. 
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2. 


The best of an approximation algorithm is to come as close as possible 
to the optimum value in a reasonable amount of time which is at 
most polynomial time. 

Let c(i) be the cost of solution produced by approximate algorithm 
and c*(i) be the cost of optimal solution for some optimization 
problem instance i. 

For minimization and maximization problem, we are interested in 
finding a solution of a given instance i in the set of feasible solutions, 
such that c(i) /c*(z) and c**(i)/ c(i) be as small as possible respectively. 
We say that an approximation algorithm for the given problem 
instance i, has a ratio bound of p(n) if for any input of size n, the 
cost c of the solution produced by the approximation algorithm is 
within a factor of p(n) of the cost c* of an optimal solution. That is 
max(c(i) / c*(z), e*(i) / c(i)) < p(n) 

The definition applies for both minimization and maximization 
problems. 

p(n) is always greater than or equal to 1. If solution produced by 
approximation algorithm is true optimal solution then clearly we 
have p(n) = 1. 

For a minimization problem, 0 <c*(i) < c(i), and the ratio c(i) / c*(i) 
gives the factor by which the cost of the approximate solution is 
larger than the cost of an optimal solution. 

Similarly, for a maximization problem, 0 < c(i) <c*(i), and the ratio 
c*(i)/ c(i) gives the factor by which the cost of an optimal solution 
is larger than the cost of the approximate solution. 

Travelling salesman problem (TSP) is an example of approximation 
algorithm. 


SECTION - C 


: Attempt any two questions from this section : (15 x 2 =30) 


What is Fibonacci heap ? Explain CONSOLIDATE operation 
with suitable example for Fibonacci heap. 

Fibonacci heap: 

A Fibonacci heap is a set of min-heap-ordered trees. 

Trees are not ordered binomial trees, because 

Children of a node are unordered. 

Deleting nodes may destroy binomial construction. 

Fibonacci heap H is accessed by a pointer min[H] to the root of a 
tree containing a minimum key. This node is called the minimum 
node. 

If Fibonacci heap H is empty, then min[H] = NIL. 
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min(H) 





Fig. 7. 
CONSOLIDATE operation : 
CONSOLIDATE (A) 
for i <— 0 to Din[A]) 
do A[i] < NIL 
for each node w in the root list of H 
dox <w 
d < degree[x] 
while A[d] # NIL 
do y < Ald] p Another node with the same degree as x. 
if key[x] > keyly] 
then exchange x > y 
FIB-HEAP-LINK(H, y, x) 


. Ald] — NIL 


d<d+l 


. Ald] — x 


min[H] < NIL 

for i < 0 to D(n[H]) 

do if A[i] NIL 

then add Al[z] to the root list of H 

if min[H] = NIL or key [AIi]] < key[min[H]] 
then min[H] < A[z] 

FIB-HEAP-LINK(H, y, x) 

remove y from the root list of H 

make y a child of x, incrementing degree|[x] 
markly] < FALSE 


. Whatis minimum spanning tree ? Explain Prim’s algorithm 


and find MST of graph Fig. 8. 
6 
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Minimum spanning tree : 
Given a connected weighted graph G, it is often desired to create a 


spanning tree T for G such that the sum of the weights of the tree 
edges in T is as small as possible. 

Such a tree is called a minimum spanning tree and represents the 
“cheapest” way of connecting all the nodes in G. 

There are number of techniques for creating a minimum spanning 
tree for a weighted graph but the most famous methods are Prim’s 
and Kruskal’s algorithm. 

Prim’s algorithm : 

First it chooses a vertex and then chooses an edge with smallest 
weight incident on that vertex. The algorithm involves following 
steps: 

Step 1: Choose any vertex V, of G. 

Step 2 : Choose an edge e, =V,V, of G such that V,# V, ande, has 
smallest weight among the edge e of G incident with V,. 


Step 3: If edges e,, és, ....... , e; have been chosen involving end 
points V,, Vo, vse , V;, choose an edge e,,, = VV, with V; ={V, 
abuts V,,,} and V, ¢ {V, ...........V,,,} such that e;,, has smallest 
weight among the edges of G with precisely one end in {V}............. 
Vi}. 

Step 4: Stop after n — 1 edges have been chosen. Otherwise goto 
step 3. 

Numerical : 





Fig. 9. 
Let a be the source node. Select edge (a, b) as distance between 
edge (a, b) is minimum. 


Now, select edge (6, c) 
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Now, select edge (c, i) 
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12. 


Ans. 


Now, select edge (e, d) 





Thus, we obtained MST for Fig. 9. 


Explain TSP (Travelling Salesman) problem with example. 
Write an approach to solve TSP problem. 

Travelling Salesman Problem (TSP) : 

Travelling salesman problem is the problem to find the shortest 
possible route for a given set of cities and distance between the 
pair of cities that visits every city exactly once and returns to the 
starting point. 

For example: 

The following graph shows a set of cities and distance between 
every pair of cities : 





35 

If salesman starting city is A. Then a TSP tour in the graph is 
A>S>BOD>SCHA 

Cost of the tour = 10 + 25 + 30 + 15 = 80 Units. 

Backtracking approach is used to solve TSP problem. 

Backtracking algorithm for the TSP : 

Let G be the given complete graph with positive weights on its 

edges. 

Use a search tree that generates all permutations of V= {1... n}, 

specifically the one illustrated in Fig. 10 for the case n = 3. 
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Fig. 10. 

3. A node at depth i of this tree (the root is at depth 0) stores an 
i-permutation of {1, ..., n}. A leaf stores a permutation of {1, ..., n}, 
which is equivalent to saying that it stores a particular Hamiltonian 
cycle (tour) of G. 

4. For the travelling salesman problem, we will not do any static 
pruning on this tree, we will do dynamic pruning, during the search. 


OOO 











Design and Analysis of Algorithms SP-1 B (CS/IT-Sem-5) 





B. Tech. 
(SEM. V) ODD SEMESTER THEORY 
EXAMINATION, 2016-17 


DESIGN AND ANALYSIS OF ALGORITHMS 


Time : 3 Hours Max. Marks : 100 


Note: 


Section-A 


Attempt all parts. All parts carry equal marks. Write answer of 
each part in short. (2 x 10 = 20) 


List out the disadvantages of divide and conquer algorithm. 


What are the fundamental steps involved in algorithmic 
problem solving ? 


Write recursive function to find n Fibonacci number. 
Define binary heap. 

Briefly explain the Prim’s algorithm. 

Define principle of optimality. 

Write the names of various design techniques of algorithm. 


Differentiate between branch and bound and backtracking 
technique. 


What is the running time complexity of 8-Queens problem ? 

Define P, NP and NP-complete in decision problem. 
Section-B 

Attempt any five questions from this section. (10 x 5 =50) 

Explain the concepts of quick sort method and analyze its 

complexity with suitable example. 


Explain the concept of merge sort with example. 


Insert the nodes 15, 13, 12, 16, 19, 23, 5, 8 in empty red-black 
tree and delete in the reverse order of insertion. 
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5. 


11. 


12. 


Write short note on Dijkstra’s algorithm shortest paths 
problems. 


Write pseudocode for 8-Queens problem. 
Write non-deterministic algorithm for sorting. 


What is backtracking ? Write general iterative algorithm 
for backtracking. 


Differentiate NP-complete with NP-hard. 


Section-C 


: Attempt any two questions from this section. (15 x 2=30) 
. State Bellman-Ford algorithm. 
. Consider following instance for simple knapsack problem. 


Find the solution using greedy method. 
N=8 

P ={11, 21,31, 33, 43, 53, 55, 65} 

W =({1, 11, 21, 23, 33, 43, 45, 55} 

M=110 


What is travelling salesman problem ? Find the solution of 
following travelling salesman problem using branch and 
bound method. 


co 20 30 10 11 


15 o 16 4 2 
Cost matrix=|3 5 o 2 4 
19 6 6 3 
146 4 7 16 


Prove that three colouring problem is NP-complete. 


OOO 
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Ans. 


SOLUTION OF PAPER (2016-17) 


Section-A 


Attempt all parts. All parts carry equal marks. Write answer of 
each part in short. (2 x 10 = 20) 


List out the disadvantages of divide and conquer algorithm. 
Disadvantages of divide and conquer algorithm : 
Recursion is slow. 

Algorithm becomes complicated for large value of n. 


What are the fundamental steps involved in algorithmic 
problem solving ? 

Steps involved in algorithmic problem solving are : 
Characterize the structure of optimal solution. 

Recursively define the value of an optimal solution. 


. By using bottom-up technique, compute value of optimal solution. 


Compute an optimal solution from computed information. 


Write recursive function to find n** Fibonacci number. 


2 int fibo(int num) 


if (num == 0) 

{ 

return 0; 

} 

else if (num == 1) 
{ 

return 1; 

} 

else 

{ 
return(fibo(num — 1) + fibo(num — 2)); 
} 

} 


Define binary heap. 
The binary heap data structure is an array that can be viewed as a 
complete binary tree. Each node of the binary tree corresponds to 
an element of the array. The tree is completely filled on all levels 
except possibly lowest. 


Briefly explain the Prim’s algorithm. 
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Ans: First it chooses a vertex and then chooses an edge with smallest 
weight incident on that vertex. The algorithm involves following 


steps: 

Step 1 : Choose any vertex V, of G. 

Step 2 : Choose an edge e, =V,V, of G such that V,# V, ande, has 
smallest weight among the edge e of G incident with V,. 


Step 3: If edges e,, ey, ....... , e; have been chosen involving end 
points Vy, Va, ...eeeeee , Vi, choose an edge e,,, = Viv, with 
V; = {Vy wee, Vij} and V, € (Vy wee V,,,} such that e,,, has 
smallest weight among the edges of G with precisely one end in 
AV jessscedhGvataies Vi. 

Step 4: Stop after n — 1 edges have been chosen. Otherwise goto 
step 3. 


f. Define principle of optimality. 


Ans: Principle of optimality states that in an optimal sequence of decisions 
or choices, each subsequence must also be optimal. 


g. Write the names of various design techniques of algorithm. 
S: Various design techniques of algorithm are: 

1. Divide and conquer 

2. Greedy approach 

3. Dynamic programming 

4. Branch and bound 

5. Backtracking algorithm 


h. Differentiate between branch and bound and backtracking 
technique. 





Branch and bound Backtracking 


1. |In this method, it is not| Solution for backtracking is traced 
necessary to use depth first| using depth first search. 
search for obtaining the 
solution, even the breadth 
first search, best first search 
can be applied. 





2. |Typically optimization] Typically decision problems can be 
problems can be solved using} solved using backtracking. 
branch and bound. 














i. What is the running time complexity of 8-Queens problem ? 


Ans: The running time complexity of 8-Queens problem is O(P(n)n!) 
where P(7) is polynomial in n. 
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j. 
Ans. 


Note: 


Pon Pr 


SAOAPwWNE 


Define P, NP and NP-complete in decision problem. 
P-polynomial time : These problems can be solved in polynomial 
time, which take time like O(n), O(n?), O(n) like finding maximum 
element in an array or to check whether a string is palindrome or 
not are P problems. 

Non deterministic polynomial time : These problem cannot be 
solved in polynomial time like TSP (Travelling Salesman Problem) 
or subset sum are NP problem. 

But NP problems are checkable in polynomial time means that 
given a solution of a problem, we can check that whether the 
solution is correct or not in polynomial time. 

NP-complete : The group of problems which are both in NP and 
NP-hard are known as NP-complete problem. 


Section-B 


Attempt any five questions from this section. (10 x 5=50) 


. Explain the concepts of quick sort method and analyze its 


complexity with suitable example. 

Quick sort: 

Quick sort works by partitioning a given array Alp ... r] into two 
non-empty subarray Alp ...q—1] andA [q+ 1...r] such that every 
key in A[p ... g—1] is less than or equal to every key in Alg +1... r]. 
Then the two subarrays are sorted by recursive calls to quick sort. 
Quick_Sort (A, p, r) 

Ifp<rthen 

qa < Partition (A, p, r) 

Recursive call to Quick_Sort (A, p, g—-1) 

Recursive call to Quick_Sort (A, g + 1,7) 

As a first step, Quick sort chooses as pivot one of the items in the 
array to be sorted. Then array is partitioned on either side of the 
pivot. Elements that are less than or equal to pivot will move toward 
the left and elements that are greater than or equal to pivot will 
move toward the right. 


Partition (A, p, r) 
x<Alr] 

i<p-1 
forj<ptor-1 
do if Aly] <x 


theni<i+1 

then exchange Ali] © Af] 
exchange Ali + 1] © Alr] 

returni +1 

Example : Given array to be sorted 


3/1/4/1)/5/9/2/6|5)3)5)|8)]9 
Sort the array A using quick sort algorithm. 
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Step 1: The array is Pivoted about it first element i.e., Pivot (P) =3 





Step 2: Find first element larger then pivot (make underline) and 
find element not larger than pivot from end make over line. 





Underline Overline 
Step 3: Swap these element and scan again. 





Underline Overline 
Apply swapping, 





Overline Underline 
The pointers have crossed 
i.e., overline on left of underlined 
Then, in this situation swap pivot with overline. 





Now, pivoting process is complete. 
Step 4: Recursively sort subarrays on each side of pivot. 


Subarray 1:|2]1]3/1 


























Subarray 2:/9/5/6/5]/1/5/8/9 
First apply Quick sort for subarray 1. 
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a1 |7)s) 
POA A 


Underline Overline 
The pointers have crossed. 


i.e., overline on left of underlined. 
Swap pivot with overline 

1/1/2)3 
Sorted array 























Now, for subarray 2 we apply Quick sort procedure. 





Overline Underline 
The pointer has crossed. Then swap pivot with overline. 





Subarray 4 
Subarray 3 
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Analysis of complexity : 

Worst case : 

Let T(n) be the worst case time for quick sort on input size n. We 
have a recurrence 


Tin) = max (T(q) + Tin -q- 1) + O(n) A) 
o<q<n— 


where qg ranges from 0 to n — 1, since the partition produces two 
regions, each having size n — 1. 

Now we assume that T(n) < cn? for some constant c. 
Substituting our assumption in eq. (1.19.1) we get 


T(n) < me (eq? + c(n —q —1)*) + O(n) 
o<q<n- 


= max (q?+(n—q-—1)?)+ O(n) 


o<qs<n-1 

Since the second derivative of expression q? + (n — q — 1)? with 
respect to q is positive. Therefore, expression achieves a maximum 
over the range 0 <q <n-—1 at one of the endpoints. 
This gives the bound 
MAXg <g<n_1 (G+ (n-g- 1”) <(n-1)?=n?-2n+1 
Continuing with the bounding of T(n) we get 

T(n) < en? — c(2n — 1) + O(n) < en? 
Since we can pick the constant c large enough so that the c(2n — 1) 
term dominates the @(n) term. We have 

T(n) = O(n?) 


7. Thus, the worst case running time of quick sort is @(n”). 


. Average case: 


If the split induced of RANDOMIZED_PARTITION puts constant 
fraction of elements on one side of the partition, then the 
recurrence tree has depth © (log n) and O(n) work is performed at 
each level. 
This is an intuitive argument why the average case running time 
of RANDOMIZED_QUICKSORT is O(n log n). 
Let T(n) denotes the average time required to sort an array of n 
elements. A call to RANDOMIZED_ QUICKSORT with a 1 element 
array takes a constant time, so we have 7(1) = 0 (1). 
After the split RANDOMIZED_QUICKSORT calls itself to sort 
two subarrays. 
The average time to sort an array A[1..q] is Tlq] and the average 
time to sort an array A[g+1 .. n] is T[n — q]. We have 
T(n) = 1/n (T(1) + Tn —- 1) + PSS Si T(q) 
T(n —q))) + O(n) (1) 
We know from worst-case analysis 
T(1) = © (1) and T(n —- 1) = O(n?) 
T(n) = 1/n (@ (1) + O(n?) + In 10) 3) (r(q) 
+ T(n -— q)) + Q(n) 
=In"'18 -, (Tq) + Tin - q)) + Qin) (2) 
= Un (2"-48,_,(Tk))] + O(n) 
= 2n”18,_, (T(k)) + O(n) ..(8) 
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6. Solve the above recurrence using substitution method. Assume 
that T(n) <an n logn + b for some constants a > 0 and b > 0. 
If we can pick ‘a’ and ‘’ large enough so that n log n + 6 > T(1). 
Then for n > 1, we have 
T(n) =""10,_, 2/n (ak log k + b) + O(n) 
= 2ain"18,_,k log k — 1/8(n?) + 2b/n 
(n-1)+On 4) 
At this point we are claiming that 
no, _,klogk< 1/2 n” log n— 1/8(n?) 
Substituting this claim in the eq. (4), we get 
T(n) <2a/n [1/2n? log n — 1/8(n?)] + 2/n b(n — 1) + © (n) 
< an logn—an/4 + 2b + O(n) ..(5) 
In the eq. (5), O(n) + 6 and an/4 are polynomials and we can choose 
‘a’ large enough so that an/4 dominates O(n) +b. 
We conclude that QUICKSORT’s average running time is O(n log 
n). 


3. Explain the concept of merge sort with example. 


1. Merge sort is a sorting algorithm that uses the idea of divide and 
conquer. 

2. This algorithm divides the array into two halves, sorts them 
separately and then merges them. 

3. This procedure is recursive, with the base criteria that the number 
of elements in the array is not more than 1. 
Algorithm : 
MERGE_SORT (a, p, r) 

1. ifp<r 

2. theng —L(ip + ry/2] 

3. MERGE-SORT (A, p, q) 

4. MERGE-SORT (A, g + 1,7) 

5. MERGE (A, p, q,1r) 


MERGE (A, p, q,r) 
1. ny=q-pr+l 
2. Ng=r-q 
3. Create arrays L [1......... n,+1] and 
R [L.....ny + 1 
4, fori = 1ton, 
do 
Lili] =A [p+i-1 
endfor 
5. for j = 1ton, 
do 
Rij) = Alg +7] 
endfor 


6. Lin, + 1) = ~, Rin, + 1) = 
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Ans. 


i=1,j=1 
fork =ptor 
do 
if Lii] < RU) 
then A[k] < Li] 
t=i+1 
else Al[k] = RU 
J=jtl 
endif 
endfor 
exit 
Example: 


10, 25, 16, 5, 35, 48, 8 


Divide into two halves : 10, 25, 16, 5 35, 48, 8 


. Consider the first part:10, 25, 16, 5 again divide into two 


sub- arrays 


16>; 5 





5, 10, 16, 25 


Consider the second half : 35, 48, 5 again divide into two sub- 
arrays 


35 , 48 8 
35, 48 8 
8, 35, 48 


Merge these two sorted sub-arrays, 


5,10, 16, 25 8, 35, 48 





5, 8, 10, 16, 25, 35, 45 


This is the sorted array. 


Insert the nodes 15, 13, 12, 16, 19, 23, 5, 8 in empty red-black 
tree and delete in the reverse order of insertion. 
Insertion : 


B 
Insert 15: (5) 
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B 
R45) 
Insert 13: 


Insert 12: 


we 
7 


Insert 16 
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Insert 8: 





Deletions : 
Delete8: 





Delete 19: 


ON R ON Case2 B On 
B(12) 18) — B(2) 0) — (2) (1B 
BOS * (19) B BGS Gr 
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sO? 


) 


Delete 16: 





Delete 12: 


oe 


Delete 13: 
"OQ. —'® 
“C) B 
Delete 15: 
No tree 


Write short note on Dijkstra’s algorithm shortest paths 
problems. 


Dijkstra’s algorithm, is a greedy algorithm that solves the single 
source shortest path problem for a directed graph G = (V, E) with 
non-negative edge weights, i.e., we assume that w(u, v) > 0 each 
edge (u,v) € E. 

Dijkstra’s algorithm maintains a set S of vertices whose final 
shortest path weights from the source s have already been 
determined. 

That is, for all vertices v <¢ S, we have d[v] = Os, v). 

The algorithm repeatedly selects the vertex u ¢ V—S with the 
minimum shortest path estimate, inserts u into S, and relaxes all 
edges leaving u. 

We maintain a priority queue @ that contains all the vertices in 
vu —s, keyed by their d values. 

Graph G is represented by adjacency list. 

Dijkstra’s always chooses the “lightest or “closest” vertex in V—S 
to insert into set S that it uses as a greedy strategy. 


Dijkstra’s algorithm : 
DIJKSTRA (G, w, s) 


INITIALIZE-SINGLE-SOURCE (G, s) 
seo 
Q<« VIG] 
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Rone = 


a 


RELAX (u, v, w): 
. Ifd[u] + w(u, v) < d[v] 
. then div] < d[u] + w(u, v) 


oa PR wh 


4. whileQ+o 
5. dou< EXTRACT-MIN (Q) 
6. 
iq 
8 


S<Svu{u} 
for each vertex v € Adj [u] 


do RELAX (u, v, w) 


mlv] <u 


. Write pseudocode for 8-Queens problem. 
; Pseudocode for N-Queens problem : 


N-Queens are to be placed on an n x n chessboard so that no two 
attack i.e., no two Queens are on the same row, column or diagonal. 
PLACE (R, i) 


. forj<1tok-1 

. do if (x(j) = 7) or Abs (x[j] — 7) = (Abs (j - k)) 
. then return false 

. return true 


Place (k, i) returns true if a queen can be placed in the k row and 
ith column otherwise return false. 

x[] is a global array whose first k — 1 values have been set. Abs(r) 
returns the absolute value of r. 


N-Queens (k, n) 


. fori<c-lton 


do if PLACE (z, i) 
then x[k] <i 
if k =n, then print x[1.... N] 


. else N-Queens (& + 1, n) 


[Note : For 8-Queen problem put n = 8 in the algorithm.] 


. Write non-deterministic algorithm for sorting. 
; Non-deterministic algorithms are algorithm that, even for the same 


input, can exhibit different behaviours on different runs, iterations 
and executions. 


NSORT(,B): 


. fori =1tondo 
. J=choice(1...n) 
. if Bly] !=0 then failure 


BU) = Ali] 


. endfor 
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SH AA 


for i= 1ton—1do 
if Bli] < Bli + 1] then failure 
endfor 


print(B) 
success 


What is backtracking ? Write general iterative algorithm 
for backtracking. 


Backtracking is a general algorithm for finding all solutions to 
some computational problems. 
Backtracking is an important tool for solving constraint satisfaction 
problems, such as crosswords, verbal arithmetic, and many other 
puzzles. 
It is often the most convenient (if not the most efficient) technique 
for parsing, for the knapsack problem and other combinational 
optimization problem. 
It can be applied only for problems which admit the concept of a 
“partial candidate solution” and a relatively quick test of whether 
it can possibly be completed to a valid solution. 
Iterative backtracking algorithm : 
algorithm ibacktrack (n) 
// Iterative backtracking process 
// All solutions are generated in x[1 : n] and 
printed as soon as they are found 
{ 
k=1; 
while (z != 0) 
{ 
if ( there remains an untried x[k] in T(x[1], x[2], ..., x[2 — 1) 
and B_AR(x[1], ..., x[R] ) is true ) 
{ 


if (x[1], ..., x[k] is a path to an answer node ) 

write (x[1: k]); 

k=k+1; // Consider the next set 

} 

else 

k=k-1; // Backtrack to the previous set 


} 
} 


9. Differentiate NP-complete with NP-hard. 
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Ans. 
S. No. NP-complete NP-hard 
1. An NP-complete problems | NP-hard problems is one to which 
is one to which every other | an NP-complete problem is 
polynomial-time non- Turing-reducible. 
deterministic algorithm can 
be reduced in polynomial 
time. 
2. NP-complete problems do | NP-hard problems correspond to 
not corresponds to an | an NP-complete problem. 
NP-hard problem. 
3. NP-complete problems are | NP-hard problems need not to be 
exclusively decision decision problem. 
problem. 
4, NP-complete problems | NP-hard problems do not have to 
have to be in NP-hard and | bein NP. 
alsoin NP. 
5. For example : 3-SAT | For example: Halting problem is 
vertex cover problem is | NP-hard. 
NP-complete. 
Section-C 
Note: Attempt any two questions from this section. (15 x 2=30) 
10.i. State Bellman-Ford algorithm. 
ii. Consider following instance for simple knapsack problem. 
Find the solution using greedy method. 
N=8 
P = {11, 21, 31, 33, 43, 53, 55, 65} 
W = {1, 11, 21, 23, 33, 43, 45, 55} 
M= 110 
Ans. 
i. 
1. Bellman-Ford algorithm finds all shortest path length from a source 
s e Vtoallv e V or determines that a negative-weight cycle exists. 
2. Bellman-Ford algorithm solves the single source shortest path 
problem in the general case in which edges of a given digraph G 
can have negative weight as long as G contains no negative cycles. 
3. This algorithm, uses the notation of edge relaxation but does not 
use with greedy method. 
4. The algorithm returns boolean TRUE if the given digraph contains 


no negative cycles that are reachable from source vertex otherwise 
it returns boolean FALSE. 
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wWOnNre 


ii. 


SNA AR WN E 


Bellman-Ford (G, w, s): 


. INITIALIZE-SINGLE-SOURCE (G; s) 
. for each vertex i < 1 to V[G]-1 


do for each edge (u, v) in E[G] 
do RELAX (u, v, w) 


. for each edge (u, v) in E[G] do 


do if d[u] + w(u, v) < d[v] then 
then return FALSE 


. return TRUE 


RELAX (u, v, w): 


. Ifd[u] + w(u, v) < d[v] 
. then dlv] < dlu] + w(u, v) 
. th) <u 


If Bellman-Ford returns true, then G forms a shortest path tree, 
else there exists a negative weight cycle. 


N=8 


W = (1, 11, 21, 23, 33, 48, 45, 55} 
P=(11, 21, 31, 33, 43, 58, 55, 65} 








M=110 
Now, arrange the value of P, in decreasing order 
W, P, V, =W, xP, 

1 1 11 11 
2 11 21 231 
3 21 31 651 
4 23 33 759 
5 33 43 1419 
6 43 53 2279 
7 45 55 2475 
8 55 65 3575 

















Now, fill the knapsack according to decreasing value of P.. First we 
choose item N = 1 whose weight is 1. 

Then choose item N = 2 whose weight is 11. 

Then choose item N = 3 whose weight is 21. 

Now, choose item N = 4 whose weight is 23. 

Then choose item N = 5 whose weight is 33. 

Total weight in knapsack is = 1 + 11+ 21+ 23 + 33 = 89 

Now, the next item is N = 6 and its weight is 43, but we want only 
21 because M = 110. 

So, we choose fractional part of it, i.e., 

The value of fractional part of N = 6 is, 


—— x 21 =1113 
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Thus, the maximum value is, 


= 11+ 231+ 651+ 759 + 1419 + 1113 
= 4184 


11. What is travelling salesman problem ? Find the solution of 


Ans. 


following travelling salesman problem using branch and 
bound method. 


co 20 30 10 11 


15 o 16 4 2 
Cost matrix=|3 5 wo 2 4 
19 6 6 wo 8 
16 4 7 16 


Travelling salesman problem : 

Travelling salesman problem is the problem to find the shortest 
possible route for a given set of cities and distance between the 
pair of cities that visits every city exactly once and returns to the 
starting point. 

Branch and bound method and backtracking approach are used to 
solve TSP problem. 

Numerical : 


ao 20 30 10 11 
15 o 16 4 2 
Costmatrix=|3 5 o 2 4 
19 6 6 wo 8 
164 7 16 


Reduce each column and row by reducing the minimum value from 
each element in row and column. 
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Row Column 

1 3 

_ v v 
10/2 10 20 0 1 © 10 17 +O 
2—-~/13 7° 14 2 0O 12 2 11. 2 
2—-~/1 3 ° 0 2 0 3 * 0 
3—~/16 3 3 © 0 145 3 0 °% 
4 > |12 0 312 @ 11 0 oO 12 














2. So, total expected cost is:10+2+2+3+4+1+4+3= 285. 





perveer 


3. We have discovered the root node V, so the next node to be expanded 
will be V,, V;, V,, V;. Obtain cost of expanding using cost matrix for 


node 2. 

4, Change all the elements in 1°‘ row and 2"4 column. 
[ co oe) co ioe) 00 | 
12 © 11 2 
M,=| 0 © ow 
15 «© O 

[11 «© O | 
5. Now, reducing M, in rows and columns, we get : 
[ co oe) co oe) 00 | 
12 © 11 2 0 

2 00 wo 0 2 
15 0 0 wo O 

[11 © O 12 ow 


-. Total cost for M, = 25 + 10+ 0=35 
6. Similarly, for node 3, we have : 


S 
ll 





co co oe) co oe) 
12 0 o 2 0 
M,=| 0 3 2 
15 3 0 wo 0 
oe) oe) 

8 





[11 0 12 
7. Now, reducing M,, we get : 


co co oO 


8 ow 8 
8B ono 8 


oO 
co 
15 3 © 
11 0 @ 
.. Total cost for M, = 25+ 17+0= 42 
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8. Similarly, for node 4, we have : 


co oo co co co 
12 © 11 © O 
M,= 0 3 © wo 2 
15 3 00 0O 
11 0 00 ow 


9. Now, reducing M,, we get : 





co 0 ioe) co co 
12 © 11 © O 
M,=| 0 3 © wo 2 
15 3 00 O 
11 0 0H 





.. Total cost = 25+0+0 = 25 
10. Similarly, for node 5, we have : 


co oe) co oe) co 
12 © 11 2 w 
Mz=| 0 3 © 0 
15 3 0 © ow 
11 0 0 12 ow 


11. Now, reducing M,, we get: 


0 0 0 © © 
10 © 9 0 w 
Mz=| 0 3 © 0 
15 3 0 © ow 
11 0 0 12 ow 








Fig. 1. 
12. Now, the promising node is V, = 25. Now, we can expand V,, V, and 
V;. Now, the input matrix will be M,. 
13. Change all the elements in 4 row and 2"4 column. 
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14. 


15. 


16. 


17. 


18. 


0 0 © © 
12 © 11 © O 

M,= 00 0 wo 2 
0 0 © © 

11 © 0 0 w 


On reducing M,, we get : 





0 0 © 2 
12 © 11 © O 
M,=| 0 0 © wo 2 
0 0 © 0 
11 © 0 0 w 


.. Total cost = 25 + 3 + 0 = 28 
Similarly, for node 3, we have : 


[ ioe) oe) ioe) oe) 00 | 

12 ~~ 0 wo O 

M,=| 90 3 0 © 2 
0 8 0 wo 0 
[11 0 «© © ow] 

On reducing M,, we get 

[ ioe) ioe) ioe) ioe) 00 | 

12 0 0 wo O 

M,= 0 3 02 wo 2 
on 38 0 wo 0 

11 0 © © w 





.. Total cost = 25+0+0=25 
Similarly, for node 5, we have : 


co co CO CO 0 





12 © 11 © ow 

M,=| 0 3 © w ow 
0 0 © 2 

[11 0 0 © 

On reducing M,, we get : 
[0 0 0 0 © 

1 0 0 © w 

M,=| 0 3 © © ow 
0 0 0 © 

11 0 0 © 
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19. 


20. 


21. 


22. 


23. 


.. Total cost = 25+0+11=36 


Now, promising node is V, = 25. Now, we can expand V, and V;. 
Now, the input matrix will be M,. 
Change all the elements in 3" row and 2"4 column. 


[co 0 «© 0 © 

12 0 0 wo O 

My =| 0 © © © 
co 0 0 o Q 

[11 2 «© 0 

On reducing M,, we get 

[co 0 «0 0 
100 oo OQ 

My =|0 © © © 
ao 0 0 o OQ 

0 0 © 0 





.. Total cost = 25+3+0= 28 
Similarly, for node 5, we have : 
[ oe) ioe) ioe) co 20 | 
12 © © © 
M,)=| 2 © 2 
o 8 «© 0 
11 0 © ow 
On reducing M,, we get : 
[ co ioe) ioe) ioe) 
0 0 0 
M,)=| 2 © %© 
co 0 «© 


[11 0 © % o} 
.. Total cost = 25+24+124+3= 42. 
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24. 


12. 
Ans. 


V, = 28 V; = 42 
Fig. 3. 
Here V, is the most promising node so next we are going to expand 
this node further. Now, we are left with only one node not yet 
traversed which is V;. 





0. 6 5 2 6 
A A ee en aA 

So, total cost of traversing the graph is : 
10+6+5+2+16=39 


Prove that three colouring problem is NP-complete. 


To show the problem is in NP, let us take a graph G(V, E) anda 
colouring c, and checks in O(n? ) time whether c is a proper colouring 
by checking if the end points of every edge e ¢ E have different 
colours. 

To show that 3-COLOURING is NP-hard, we give a polytime 
reduction from 3-SAT to 3-COLOURING. 

That is, given an instance ¢ of 3-SAT, we will construct an instance 
of 3-COLOURING (7.e., a graph G(V, E)) where G is 3-colourable iff 
is satisfiable. 

Let @ be a 38-SAT instance and C,, C4, ..., C,, be the clauses of 
defined over the variables {x,, xo, ...,x,}. 

The graph G(V, E) that we will construct needs to capture two 
things : 

Somehow establish the truth assignment for x,, x, ..., x, via the 
colours of the vertices of G; and 

Somehow capture the satisfiability of every clause C; in 9. 

To achieve these two goals, we will first create a triangle in G with 
three vertices {T, F, B} where T stands for True, F for False and B 
for Base. 

Consider {T, F, B} as the set of colours that we will use to colour 
(label) the vertices of G. 

Since this triangle is part of G, we need 3 colours to colour G. 
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9. Now we add two vertices v,,0; for every literal x, and create a 


10. 
11. 


12. 


13. 


14. 


15. 


16. 


triangle B, v, ,0, for every (v, , 0; ) pair, as shown in Fig. 4. 





Fig. 4. 
This construction captures the truth assignment of the literals. 


Since if G is 3-colourable, then either v, or 5; gets the colour T, and 


we interpret this as the truth assignment to v,. 
Now we need to add constraints to G to capture the satisfiability of 
the clauses of 6. 


The output node 





Fig. 5. 
To do so, we introduce the Clause Satisfiability Gadget, (the OR- 
gadget). For a clause C; = (a v b vc), we need to express the OR of 
its literals using our colours {T, F, B}. 
We achieve this by creating a small gadget graph that we connect to 
the literals of the clause. The OR-gadget is constructed as follows : 
Consider this gadget graph as a circuit whose output is the node 
labeled a v b v c. We basically want this node to be coloured Tif C, 
is satisfied and F otherwise. 
This is a two step construction : The node labelled a v b captures the 
output of (a v b) and we repeat the same operation for ((a v 6) vc). 
If we play around with some assignments to a, b, c, we will notice 
that the gadget satisfies the following properties : 
Ifa, b,c are all coloured F in a 3-colouring, then the output node of 
the OR-gadget has to be coloured F. Thus capturing the 
unsatisfiability of the clause C,; = (av b vc). 
If one of a, b, c is coloured JT, then there exists a valid 
3-colouring of the OR-gadget where the output node is coloured T. 
Thus again capturing the satisfiability of the clause. 
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17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 


26. 


27. 


Once we add the OR-gadget of every C; in , we connect the output 
node of every gadget to the Base vertex and to the False vertex of 
the initial triangle, as follows : 





Fig. 6. 
Now we prove that our initial 3-SAT instance 9 is satisfiable if and 
only the graph G as constructed above is 3-colourable. Suppose ¢ is 
satisfiable and let (x,*, x.*, ...,x,* ) be the satisfying assignment. 


If x,* is assigned True, we colour v, with T and 9, with F (recall 


they are connected to the Base vertex, coloured B, so this is a valid 
colouring). 

Since @ is satisfiable, every clause C, = (a v b vc) must be satisfiable, 
i.e., at least of a, b, c is set to True. By the property of the OR- 
gadget, we know that the gadget corresponding to C;, can be 3- 
coloured so that the output node is coloured T. 

And because the output node is adjacent to the False and Base 
vertices of the initial triangle only, this is a proper 3-colouring. 
Conversely, suppose G is 3-colourable. We construct an assignment 
of the literals of » by setting x, to True if v; is coloured T and vice 
versa. 

Now consider this assignment is not a satisfying assignment to 6, 
then this means there exists at least one clause C, = (a v b vc) that 
was not satisfiable. 

That is, all ofa, b, c were set to False. But if this is the case, then the 
output node of corresponding OR-gadget of C; must be coloured F. 
But this output node is adjacent to the False vertex coloured F; thus 
contradicting the 3-colourability of G. 

To conclude, we have shown that 3-COLOURING is in NP and that 
it is NP-hard by giving a reduction from 3-SAT. 

Therefore 3-COLOURING is NP-complete. 


OOO 











Design and Analysis of Algorithms SP-1 B (CS/IT-Sem-5) 





B.Tech. 
(SEM. V) ODD SEMESTER THEORY 
EXAMINATION, 2017-18 


DESIGN AND ANALYSIS OF ALGORITHM 


Time : 3 Hours Max. Marks : 100 


Note: 


Attempt all sections. Assume any missing data. 
Section-A 


Define/Explain the following: (2 x 10 = 20) 


a. Differentiate between complete binary tree and binary tree. 


NS 


Differentiate between greedy technique and dynamic 
programming. 


Solve the following recurrence using master method : 
T(n) = 4T (n/3) +n? 


Name the sorting algorithm that is most practically used 
and also write its time complexity. 


Find the time complexity of the recurrence relation 
T(n) = n+ T(n/10) + T(7n/5) 


Explain single source shortest path. 
Define graph colouring. 
Compare time complexity with space complexity. 


What are the characteristics of the algorithm ? 


. Differentiate between backtracking and branch and bound 


techniques. 
SECTION-B 
Attempt any three of the following : (10 x 3=30) 


Solve the following by recursion tree method 
T(n) =n + T(n/5) + T(4n/5) 
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b. 


> 


Insert the following information, F, S, Q, K, C, L, H, T, V, W, 
M, R, N, P, A, B, X, Y, D, Z, E, G, into an empty B-tree with 
degree f =3. 


. What is minimum cost spanning tree ? Explain Kruskal’s 


algorithm and Find MST of the graph. Also write it’s time 
complexity. 





Fig. 2. 


What is red-black tree ? Write an algorithm to insert a node 
in an empty red-black tree explain with suitable example. 


Explain HEAP SORT on the array. Illustrate the operation 
HEAP SORT on the array 
A = {6, 14, 3, 25, 2, 10, 20, 7, 6} 


SECTION-C 


Attempt any one part of the following : (10x 1=10) 
Explain convex-hull problem. 


Find the shortest path in the below graph from the source 
vertex 1 to all other vertices by using Dijkstra’s algorithm. 


50 





Fig. 2. 


Attempt any one part of the following : (10x 1=10) 
What is backtracking ? Discuss sum of subset problem with 
the help of an example. 


Write down an algorithm to compute Longest Common 
Subsequence (LCS) of two given strings and analyze its 
time complexity. 
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on 


a 


Attempt any one part of the following : (10 x 1=10) 
The recurrence T(n) = 7T(n/2) + n? describe the running 
time of an algorithm A. A competing algorithm A has a 
running time T'(n) = aT’ (n/4) + n?. What is the largest 
integer value for a A’ is asymptotically faster than A ? 


Discuss the problem classes P, NP and NP-complete with 
class relationship. 


Attempt any one part of the following : (10x 1=10) 
Explain properties of binomial heap. Write an algorithm to 
perform uniting two binomial heaps. And also to find 
minimum key. 


Given the six items in the table below and a knapsack with 
weight 100, what is the solution to the knapsack problem in 
all concepts. i.e., explain greedy all approaches and find the 
optimal solution. 



































Item ID Weight Value | Value/Weight 
A 100 40 A 
B 50 35 7 
Cc 40 20 5 
D 20 4 2 
E 10 10 1 
F 10 6 6 
Attempt any one part of the following : (10 x 1=10) 


Compute the prefix function x for the pattern P=abacab 
using Knuth-Morris-Pratt algorithm. Also explain Naive 
string matching algorithm. 


Explain approximation and randomized algorithms. 


OOO 
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SOLUTION OF PAPER (2017-18) 








Note: Attempt all sections. Assume any missing data. 
Section-A 
1. Define/Explain the following : (2 x 10 = 20) 
a. Differentiate between complete binary tree and binary tree. 
Ans. 
S.No. Complete binary tree Binary tree 
1. | Inacomplete binary tree every | A binary tree is a tree data 
level, except possibly the last is | structure in which each node has 
completely filled, and all nodes | at most two children, which are 
in the last level are as far left | referred to as the left child and 
as possible. the right child. 
2 |Itcan have between 1 and 2’! | It can have between 2’*! and 
nodes at the last level h. 2'*+1_ 1 nodes at the last level h. 
b. Differentiate between greedy technique and dynamic 
programming. 
Ans: Difference: 
Greedy method Dynamic programming 




















1. |A greedy algorithm is one | Dynamic programming can be 
that at a given point in time | thought of as ‘smart’ recursion. It 
makes a local optimization. | often requires one to break down 

a problem into smaller 
components that can be cached. 

2. | Greedy algorithms have a | Dynamic programming would 
local choice of _ the | solve all dependent subproblems 
subproblem that will lead to | and then select one that would lead 
an optimal answer. to an optimal solution. 

c. Solve the following recurrence using master method : 
T(n) = 4T (n/3) +n? 
ans: T(n) =47(n/3) + n? 


a=4, b=8, fn)=n? 
niogea = niogs4 = n261 
fin) =O (nlosea +B) 
Now, af(n/b) < ¢ fin) 
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Ans. 


- fin) < ¢ fin) 


4 
— n2< cn? 
3 


c= 


Hence, T(n) = O(n?) 


oof as 


Name the sorting algorithm that is most practically used 
and also write its time complexity. 


Quick sort algorithm is most practically used in sorting. 
Time complexity of quick sort is O(n log n). 


Find the time complexity of the recurrence relation 
T(n) = n+ T(n/10) + T(7n/5) 


a ae nee 





Ans. 


Ans. 





Mm 
re) 
S 
a 
je) 

Lee} 
= 


Explain single source shortest path. 


Single source shortest path problem states that in a given graph 
G = (V, E) we can find a shortest path from given source vertex 
s e V to every vertex uv € V. 


Define graph colouring. 


Graph colouring is a problem of colouring each vertex in graph in 
such a way that no two adjacent vertices have same colour and 


m-colours are used. 


Compare time complexity with space complexity. 
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Ans. 
S.No. 


Time complexity Space complexity 


Time complexity is the| Space complexity is the amount 
amount of time required for| of memory needed for an 
an algorithm to complete its} algorithm to solve the problem. 

process. 


























2. It is expressed using Big] It is expressed only using Big 
Oh(O), theta (0) and} Oh(O) notation. 
omega (Q) notation. 
i. What are the characteristics of the algorithm ? 
Ans: Characteristics of algorithm : 
1. Input and output : The algorithm must accept zero or more 
inputs and must produce at least one output. 
2. Definiteness : Each step of algorithm must be clear and 
unambiguous. 
3. Effectiveness : Every step must be basic and essential. 
4, Finiteness : Total number of steps used in algorithm should be 
finite. 
j. Differentiate between backtracking and branch and bound 





techniques. 


Backtracking Branch and bound 


Solution for backtracking is| In this method, it is not necessary 
traced using depth first| to use depth first search for 
search. obtaining the solution, even the 
breadth first search, best first 
search can be applied. 





Typically decision problems | Typically optimization problems can 
can be_ solved using| be solved using branch and bound. 
backtracking. 











Ans. 


SECTION-B 


Attempt any three of the following : (10 x 3=30) 
Solve the following by recursion tree method 

T(n) = n+ T(n/5) + T(4n/5) 
TN) SN tM ANA cecccccceeeees + log n times = Q (n log n) 











Design and Analysis of Algorithms SP-7 B (CS/IT-Sem-5) 





i &—: 
a 2% log n 
ss) (zs) () I» 





b. Insert the following information, F, S, Q, K, C, L, H, T, V, W, 
M, R, N, P, A, B, X, Y, D, Z, E, G, [into an empty B-tree with 
degree t = 3. 

Ans: Assumethat t=3 
2t-1=2x3-1=6-1=5 
and t-1=3-1=2 
So, maximum of 5 keys and minimum of 2 keys can be inserted in 
anode. Now, apply insertion process as : 
























































Insert F: F 

Insert S: F\S 

Insert Q: F/Q/S 

Insert K: F|K/Q|S 
Insert C: C\|F/K/Q|{S 
Insert L: C\/F)/K/L/Q/S 




















As, there are more than 5 keys in this node. 
Find median, n[x] = 6 (even) 
Median = me 7 Bd 
2 2 
Now, median = 3, 
So, we split the node by 3" key. 


— 
Median 


(splitting point) 
Move up 
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Insert H, T: 





Insert V: 





Insert W: 


[4] a] s[r]v]w] 


More than 5 keys split node from Median. 
n(x] = 6 [even] 
n[x] 6 


Median = a 3 (i.e., 3°! key move up) 





BMG 


Insert P: 


[LIM[N|P Qi 


More than 5 key 
split the node 


n(x] = 6 


Median = a = : =8 (i.e., 3° key move up) 
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Insert A, B: 





ABICrH 
Insert X,Y: 
A [B|ciF |x|  PIQIR| 


Insert D: 





[A [B|Cc[p|F x 
More than 5 key 


split the node 
nx] = 6 (even) 


Median = au melee! (i.e., 3° key move up) 





More than 5 key 
split the node 


Median = ——=7=8 (i.e., 3° key move up) 
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Fig. 1. Inserted all given information with degree t = 3. 


What is minimum cost spanning tree ? Explain Kruskal’s 
algorithm and Find MST of the graph. Also write it’s time 
complexity. 





Fig. 2. 


Minimum spanning tree (Minimum cost spanning tree) : 
Given a connected weighted graph G, it is often desired to create a 
spanning tree T for G such that the sum of the weights of the tree 
edges in T is as small as possible. 

Such a tree is called a minimum spanning tree and represents the 
“cheapest” way of connecting all the nodes in G. 

There are number of techniques for creating a minimum spanning 
tree for a weighted graph but the most famous methods are Prim’s 
and Kruskal’s algorithm. 

Kruskal’s algorithm : 

In this algorithm, we choose an edge of G which has smallest weight 
among the edges of G which are not loops. 
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ii. This algorithm gives an acyclic subgraph T of G and the theorem 
given below proves that T is minimal spanning tree of G. Following 
steps are required : 

Step 1 :Choose e,, an edge of G, such that weight of e,, w(e,) is as 
small as possible and e, is not a loop. 
Step 2 :If edges e,, €y, ......... , e; have been selected then choose an 
edge e,,, not already chosen such that 
i. the induced subgraph 
Gite, ..... e;,,}] is acyclic and 

ii. w(e,,,) is as small as possible 
Step 3 :If G has n vertices, stop after n — 1 edges have been chosen. 
Otherwise repeat step 2. 

If G be a weighted connected graph in which the weight of the 
edges are all non-negative numbers, let T be a subgraph of G 
obtained by Kruskal’s algorithm then, T is minimal spanning tree. 
Numerical : 

Step 1: Arrange the edge of graph according to weight in ascending 
order. 




















Edges Weight Edge Weight 
13 2 32 6 
46 3 17 7 
25 4 35 7 
36 5 56 7 
34 6 
41 6 

















Step 2 : Now draw the vertices as given in graph, 


©) © 


Now draw the edge according to the ascending order of weight. If 
any edge forms cycle, leave that edge. 
Step 3: Select edge 13 











Solved Paper (2017-18) SP-12 B (CS/IT-Sem-5) 








Step 4: Select edge 46 
@ - 


Step 5: Select edge 25 


bo 


Step 6 : Select edge 36 


Step 7: Select edge 23 





All the remaining edges, such as 34, 41, 12, 35, 56 are rejected 
because they form cycle. 

All the vertices are covered in this tree. So, the final tree with 
minimum cost of given graph is 





Minimum cost = 2+3+4+5+6=20 
Time complexity : Time complexity is O(|E| log ||). 
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d. What is red-black tree ? Write an algorithm to insert a node 
in an empty red-black tree explain with suitable example. 
Ans: Red-black tree: 
a. Ared-black tree is a binary tree where each node has colour as an 
extra attribute, either red or black. 
b. Itis a self-balancing Binary Search Tree (BST) where every node 
follows following properties : 
Every node is either red or black. 
The root is black. 
Every leaf (NIL) is black. 
If a node is red, then both its children are black. 
For each node, all paths from the node to descendent leave 
contain the same number of black nodes. 
Insertion algorithm : 
i. We begin by adding the node as we do in a simple binary search 
tree and colouring it red. 
RB-INSERT(T, z) 
y < nil [7] 
x < root [T] 
while x #nil [T] 
doy<x 
if keylz] < key [x] 
then x < left [x] 
else x < right [x] 
plal<y 
if y = nil [T] 
10. then root [T] <z 
11. else if key [z] < keyly] 
12. then left [y]< z 
13. else right [y] < z 
14. left [z] < nil[T] 
15. right [z] < nil[7] 
16. colour [z] < RED 
17. RB-INSERT-FIXUP(T, z) 
ii. Now, for any colour violation, RB-INSERT-FIXUP procedure is 
used. 
RB-INSERT-FIXUP(T, z) 


oP ON 


WONAOOaPwnr 


1. while colour [p[z]] = RED 
2: do if p[z] = leftlp [p [z]]] 
3. then y < right[p [p [z]]] 
4, if colour[y] = RED 
5. then colour[p [z]] < BLACK => case 1 
6. colourly] < BLACK => case 1 
7. colour|p [p [z]]]<- RED => case 1 
8. z<p lp [zl => case 1 
9. else if z = rightIplz]] 

10. then z < plz] => case 2 
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11. LEFT-ROTATE(T, z) => case 2 

12. colour [p[z]] < BLACK => case 3 

13. colour [p[p[z]]] <- RED => case 3 

14. RIGHT-ROTATE(T, p[plz]]) => case 3 

15. else (same as then clause with “right” and “left” 
exchanged) 


16. colour[root[T]] < BLACK 
For example : 


Insert 41: @ 
B 
Insert 38 : ae 
38) 
Insert 31: 
B 
B 
R a) (38) 


38 Case 3 
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oT Pw 


a 


Thus final tree is 





Explain HEAP SORT on the array. Illustrate the operation 
HEAP SORT on the array 

A = {6, 14, 3, 25, 2, 10, 20, 7, 6} 
Heap sort : 
Heap sort is a comparison based sorting technique based on binary 
heap data structure. 
Heap sort finds the largest element and puts it at the end of array, 
then the second largest item is found and this process is repeated 
for all other elements. 
The general approach of heap sort is as follows : 
From the given array, build the initial max heap. 
Interchange the root (maximum) element with the last element. 
Use repetitive downward operation from root node to rebuild the 
heap of size one less than the starting. 
Repeat step a and b until there are no more elements. 
Numerical : 
Originally the given array is : [6, 14, 3, 25, 2, 10, 20, 7, 6] 
First we call BUILD-MAX-HEAP 
heap size [A] = 9 


so, i = 4tol, call MAX-HEAPIFY (A, 7) 
i.e., first we call MAX-HEAPIFY (A, 4) 
Az [i] = 7, A [i] = A [4] = 25, A [7] =6 


1 < left [4] = 8 
r< right [4] =9 
8 <9 and 7 > 25 (False) 
Then, largest < 4 
9<9 and 6 > 25 (False) 
Then, largest = 4 
Ali) A [4] 


Now call MAX-HEAPIFY (A, 2) 
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Gi) 





(vi) (vii) 


(viii) 
Now i = 9 down to 2, and size = size — 1 and call MAX-HEAPIFY 
(A, 1) each time. 
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exchanging A [1] © A [9] 





ECE REL 


Now call MAX-HEAPIFY (A, 1) we get 
Now exchange A [1] and A [8] and size = 8-1=7 


20) (6) 
ay 00) ad G0) 


COG O © 06 D 
6 
re Patol [2 Ts [a P20 


Again call MAX-HEAPIFY (A, 1), we get 
exchange A [1] and A [7] and size = 7-1=6 


| 


Again call MAX-HEAPIFY (A, 1), we get 
exchange A [1] and A [6] and now size = 6-1=5 


7 ©) _y, 
ee 


Again call MAX-HEAPIFY (A, a 
exchange A [1] and A [5] and now size =5-1=4 
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@ 
KYO) _. & 
S ® S @ 


[2 [66 [ai | 
Again, call MAX-HEAPIFY (A, 1) 
exchange A [1] and A [4] and size=4-1=3 


=o 


call MAX-HEAPIFY (A, 1) 
exchange A [1] and A [3], size=3-1=2 


_ oe 


call MAX-HEAPIFY aes 1) 
exchange A [1] and A [2] and size=2-1=1 


_. _& 
o> — @ 


Thus, sorted array : 
en En 


SECTION-C 


3. Attempt any one part of the following : (10x 1=10) 
a. Explain convex-hull problem. 


1. The convex hull of a set S of points in the plane is defined as the 
smallest convex polygon containing all the points of S. 

2. The vertices of the convex hull of a set S of points form a (not 
necessarily proper) subset of S. 
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3. 


To check whether a particular point p ¢ S is extreme, see each 
possible triplet of points and check whether p lies in the triangle 
formed by these three points. 


Fig. 3. 
If p lies in any triangle then it is not extreme, otherwise it is. 
We denote the convex hull of S by CH(S). Convex hull is a convex 
set because the intersection of convex sets is convex and convex 
hull is also a convex closure. 
Graham-Scan algorithm : 
The procedure GRAHAM-SCAN takes as input a set Q of points, 
where | Q| = 3. It calls the functions Top(S), which return the point 
on top of stack S without changing S, and to NEXT-TO-TOP(S), 
which returns the point one entry below the top of stack S without 
changing S. 
GRAHAM-SCAN(Q) 
Let py be the point in Q with the minimum y-coordinate, or the 
leftmost such point in case of a tie. 
Let <p), Do; «++» P,,> be the remaining points in Q, sorted by polar 
angle in counter clockwise order around p, (if more than one point 
has the same angle remove all but the one that is farthest from p,). 
Top [S] — 0 
PUSH (p,,S) 
PUSH (p,,S) 
PUSH (p,, S) 
fori<-3tom 
do while the angle formed by points NEXT-To-TOP(S), Top(S), and 
p; makes a non left turn. 
do POP(S) 
PUSH (p,, S) 


. return S 


. Find the shortest path in the below graph from the source 


vertex 1 to all other vertices by using Dijkstra’s algorithm. 
50 
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Ans: Initialize: 


S:{} 
Q:1 2 3 4 5 
0 re) 00 00 re) 

S: {1} 

Q:1 2 8 4 5 
[o] oe} ioe) ioe} oe} 
S: {1} 

Q 2 8 4 = 5 





60 
100 30 


60 30 100 
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Extract min(4): 





50 





100 oo 


Extract min(3) : 





S: (1, 2, 4} 
Q:1 2 3 4 «5 
[o] ~ 07 w» » 
60 30 100 
60 [30] 100 
50 S: {1, 2, 4} 
Q:1 2 8 4 5 
[o] 7 » w~ 
10] 60 30 100 
60 100 
50 
{1, 2, 4, 3} 
3.4 «5 
© 0 © 
« 30 100 
60 100 
50 
S: (1, 2, 4,3,} 
3.4 «5 
0 0 0 
«© 30 100 
60 100 
60 
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PSO SDR NSAP ONE 


Extract min(5): 


S: {1, 2, 4, 3, 5} 
3 4 5 
ee) 00 
ao 380 100 


Attempt any one part of the following : (10 x 1=10) 
What is backtracking ? Discuss sum of subset problem with 
the help of an example. 

Backtracking : 

Backtracking is a general algorithm for finding all solutions to 
some computational problems. 

Backtracking is an important tool for solving constraint satisfaction 
problems, such as crosswords, verbal arithmetic, and many other 
puzzles. 

Sum of subset problem with example : 

In the subset-sum problem we have to find a subset s’ of the given 
set S = (Sj, S,, So, ..... , S.,) where the elements of the set S are n 
positive integers in such a manner that s’ « S and sum of the 
elements of subset ‘s” is equal to some positive integer X’. 
Algorithm for sum-subset problem : 

Subset-Sum (S, ¢) 


Ceo 
Z<S 
Keo 
t,<t 
while (Z # ) do 
K < max(Z) 
if (K < t) then 
Z<Z-K 
t,<«t,-K 
C<eCuUK 


else Z< Z-—K 
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12. printC // Subset Sum elements whose 


//Sum is equal tot, 
This procedure selects those elements of S whose sum is equal to t¢. 
Every time maximum element is found from S, if it is less than ¢ 
then this element is removed from Z and also it is subtracted from 
t. 
For example : 
Given S = <1, 2, 5, 7, 8, 10, 15, 20, 25> & m = 35 
Z<S,m=35 
k < max[Z] = 25 
K<m 
7 Z=Z-K 
Le., Z = <1, 2,5, 7, 8, 10, 15, 20> & m, <—m 
Subtracting K from m,, we get 
New m, = m,(old) — K = 35 — 25 = 10 
In new step, 
K€ max[Z] = 20 
K>m, 
Le., Z = <i, 2,5, 7, 8,10, 15> 
In new step, 
Ke max[Z] = 15 
K>m, 
ie., Z = <1, 2,5,7, 8, 10> 
In new step, 
K« max[Z] = 10 
K>m, 
Le., Z = <1, 2, 5, 7, 8> 
In new step, 
K<« max[Z] =8 
K>m, 
Le., Z= <1, 2,5,7>&m,<m, 
New m, =m,(old)-K=10-8= 2 
In new step 
K« max[Z] =7 


K>m, 
Le., Z= <1, 2, 5> 
In new step, K< max[Z] =5 
K>m, 
Le., Z= <i, 2> 
In new step, K< max[Z] =2 
K>m, 
L.e., Z=<Il1> 
In new step, 
K=1 
K<m, 


m, = 01 
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Ans. 


WHOAHAPHONEA 


Now only those numbers are needed to be selected whose sum is 
01, therefore only 1 is selected from Z and rest other number found 
as max[Z] are subtracted from Z one by one till Z become 9. 


Write down an algorithm to compute Longest Common 
Subsequence (LCS) of two given strings and analyze its 
time complexity. 

LCS-Length (X, Y): 

m < length[X] 

n < length[Y] 

fori<_ltom 

do cli, 0] < 0 

forj<Oton 

do c[0, j] < 0 

fori<_ltom 

do forj<lton 

do if x; = y F 

then cli, J] < cli- 1, 7-1] +1 


. bE, fle 


else ifcli- 1, j] >cli, j- 1] 


. then cli, j] << cli- 1 Jl 


bli, j] <<” 

else cli, j] < cli, j- 1] 
bli, J aie 

return c and b 
Note: 


“«\» means both the same. 

“t” means cli — 1, j] >cli, j- 11. 

“<” means cli — 1, j] < cli, j- 11. 

The “\ diagonal arrows lengthen the LCS. 

Time complexity : 

Since, two for loops are present in LCS algorithm first for loop runs 
upto m times and second for loop runs upto n times. So, time 
complexity of LCS is O(mn). 


Attempt any one part of the following : (10 x 1=10) 
The recurrence T(n) = 7T(n/2) + n? describe the running 
time of an algorithm A. A competing algorithm A has a 
running time T’(n) = aT" (n/4) + n?. What is the largest 
integer value for a A' is asymptotically faster than A ? 
Given that : 


T(n) = (2) +n? ab 


T(n) = ar'(®) +n? (2) 
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Here, eq. (1) defines the running time for algorithm A and eq. (2) 
defines the running time for algorithm A’. Then for finding value of 
a for which A’ is asymptotically faster than A we find asymptotic 
notation for the recurrence by using Master’s method. 


Now, compare eq. (1) by T(n) = ar”) + fn) 


we get, a=7 
b=2 
fn) = n? 
net = nee? — n281 


Now, apply cases of Master’s, theorem as: 
Case 1: fin) = O(n®®7-) 


=> fin) = O (n2:81-£) 

=> fin) = O (n2:81- 0.81) 

> fin) = O (n?) 

Hence, case 1 of Master’s theorem is satisfied. 
Thus, T(n) = 0(n"%*) 

> T(n) = 0 (n?81) 


Since recurrence given by eq. (1) is asymptotically bounded by 
6-notation by which is used to show optimum time we have to show 
that recurrence given by eq. (2) is bounded by Q-notation which 
shows minimum time (best case). 

For the use satisfy the case 3 of Master theorem, let a = 16 


T(n) = 16r"() +n? 


> a=16 
b=4 
fn) = n? 


Q(n&£) = Q(n? +B) 
Hence, case 3 of Master’s theorem is satisfied. 
> T(n) = 0 (fin)) 
> T(n) = 0 (n?) 
Therefore, this shows that A’ is asymptotically faster than A when 
a=16. 


Discuss the problem classes P, NP and NP-complete with 
class relationship. 


The notion of NP-hardness plays an important role in the 
relationship between the complexity classes P and NP. 
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Fig. 5. 


10. 


ior) 


V4 NP-complete 


= 
() NP-hard 


Relationship among P, NP, NP-complete and NP-hard problems. 


. It is also often used to define the complexity class NP-complete 


which is the intersection of NP and NP-hard. 


. Consequently class NP-hard can be understood as the class of 


problems that are NP-complete or harder. 


. There are no polynomial time algorithms for NP-hard problems. 
. A problem being in NP means that the problem is “easy” (in a 


certain specific sense), whereas a problem being NP-hard means 
that the problem is “difficult” (in another specific sense). 


. A problem being in NP and a problem being NP-hard are not 


mutually exclusive. When a problem is both in NP and NP-hard, we 
say that the problem is NP-complete. 


. All problems in NP can be solved deterministically in time O(2n). 
. Anexample of an NP-hard problem is the decision problem subset- 


sum. Given a set of integers, does any non-empty subset of them 
add up to zero ? i.e., a yes or no question, and happens to be NP- 
complete. 


. There are, also decision problems that are NP-hard but not NP- 


complete. 

For example, in the halting problem “given a program and its input, 
will it run forever” i.e., yes or no question, so this is a decision 
problem. It is case to prove that the halting problem is NP-hard but 
not NP-complete. 


. Attempt any one part of the following : (10x 1=10) 
. Explain properties of binomial heap. Write an algorithm to 


perform uniting two binomial heaps. And also to find 
minimum key. 


: Properties of binomial heap: 
. The total number of nodes at order & are 2”. 
. The height of the tree is k. 


k 
. There are exactly (*] i.e., *C, nodes at depthi fori =0,1, ....,k 


(this is why the tree is called a “binomial” tree). 


. Root has degree k (children) and its children are B, ,, B, 5, .... By 


from left to right. 
Algorithm for union of binomial heap: 


. The BINOMIAL-HEAP-UNION procedure repeatedly links binomial 


trees where roots have the same degree. 
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i. 
iv. 


e 
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The following procedure links the B, _, tree rooted at node to the 
B,_, tree rooted at node z, that is, it makes z the parent of y. Node z 
thus becomes the root of a B, tree. 

BINOMIAL-LINK (y, z) 

ply] <z 

sibling [y] < child[z] 

child[z] —y 

degreelz] < degree[z] + 1 

The BINOMIAL-HEAP-UNION procedure has two phases : 

The first phase, performed by the call of BINOMIAL-HEAP- 
MERGE, merges the root lists of binomial heaps H, and H, into a 
single linked list H that is sorted by degree into monotonically 
increasing order. 

The second phase links root of equal degree until at most one root 
remains of each degree. Because the linked list H is sorted by 
degree, we can perform all the like operations quickly. 
BINOMIAL-HEAP-UNION(H,, H,) 

H <« MAKE-BINOMIAL-HEAP ( ) 

head[H] < BINOMIAL-HEAP-MERGE(H,, H,) 

Free the objects H, and H, but not the lists they point to 

if head[H] = NIL 

then return H 

prev-x« < NIL 

x < head[H] 

next-x < sibling|[x] 

while next-x + NIL 

do if (degree[x] + degree[next-x]) or 

(sibling[next-x] + NIL and degree[sibling[next-x]] = degree[x]) 


then prev-« < x => case 1 and 2 
x < next-x => case 1 and 2 
. else if keylx] < key[next-x] 
then sibling[x] < sibling[next-x] => case 3 
BINOMIAL-LINK(next-x, x) => case 3 
else if prev-x = NIL 
=> case 4 
then head[H] < next-x 
=> case 4 
else sibling[prev-x] < next-x => case 4 
BINOMIAL-LINK(~, next-x) => case 4 
x < next-x => case 4 
. next-x < sibling[x] 
return H 
BINOMIAL-HEAP-MERGE(H,, H,) 
a < head[H,] 


b < head[H,] 
head[H,] < min-degree (a, b) 
if head[H,] = NIL 
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Ans. 


return 

if head[H,] =b 
thenb<a 

a < head[H,] 

while b NIL 

do if sibling[a] = NIL 


. then sibling[a] <b 


return 


. else if degree [sibling[a]] < degree[b] 


then a < sibling[a] 

else c < sibling[d] 

sibling[b] < siblingla] 

sibling[a] <b 

a < sibling[a] 

bec 

Minimum key : 

BINOMIAL-HEAP-EXTRACT-MIN (A) : 

Find the root x with the minimum key in the root list of H, and 
remove x from the root list of H. 

H' — MAKE-BINOMIAL-HEAP( ). 

Reverse the order of the linked list of x’s children, and set head[H"] 
to point to the head of the resulting list. 

H <« BINOMIAL-HEAP-UNION(A, 7). 

Return x 

Since each of lines 1-4 takes O(log n) time of H has n nodes, 
BINOMIAL- HEAP-EXTRACT-MIN runs in O(log 7) time. 


Given the six items in the table below and a knapsack with 
weight 100, what is the solution to the knapsack problem in 
all concepts. i.e., explain greedy all approaches and find the 
optimal solution. 




















Item ID Weight Value | Value/Weight 
A 100 40 A 
B 50 35 7 
Cc 40 20 5 
D 20 4 2 
E 10 10 1 
F 10 6 6 




















We can use 0/1-knapsack problem when the items cannot be divided 
into parts and fractional knapsack problem when the items can be 
divided into fractions. 
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First arrange in non-increasing order of value/weight : 




















Item ID Value Value/Weight 
E 10 1 
B 35 0.7 
F 6 0.6 
Cc 20 0.5 
A 100 40 0.4 
D 20 4 0.2 














According to 0/1-knapsack problem, either we select an item or 
reject. So the item will be selected according to value per weight. 
Eisselected W=10< 100 
Bisselected W=10+50 
= 60 < 100 
Fisselected W=60+ 10 
= 70 < 100 
C cannot be selected because 
W = 70+ 40=110> 100 
Hence we select D 
W = 70 + 20 = 90 < 100 
Total value = 10+ 85+6+4=55 
According to fractional knapsack problem, we can select fraction of 
any item. 
Eisselected W=10< 100 
Bisselected W=10+50 
= 60 < 100 
Fisselected W=60+ 10 
= 70 < 100 
If we select C W= 70+ 40 
= 110>100 
Hence we select the fraction of item C as 
100-W 100-70 
WeightofC 40 
Weight of C = 30/40 = 0.75 
So, W = 0.75 x 40 = 30 
W = 70+ 30= 100 
Total value = 10 + 35 + 6 + 0.75 (20) 
= 10+35+6+15=66 





7. Attempt any one part of the following : (10x 1=10) 

a. Compute the prefix function x for the pattern P=abacab 
using Knuth-Morris-Pratt algorithm. Also explain Naive 
string matching algorithm. 
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Ans. 


oP ON Pr 


Prefix function of the string abacab : 
m < length [P] 


. m=6 
Initially, x[1] = 0,2 =0 
forg<2to6 
forq=2, k+0 
& P(O + 1] + P[2] 
» m2] = 0 
for q=3, k+0 
& P[O + 1] = P[3] 
z k=k+1=1 
& n[3] = 1 
forg=4,k>0 
& P(1+1)# P[4] 
keri] =0 
P(1] # P[4] 
& m[4] = 0 
forg=5,k>0 
& P(0 + 1] = P[5) 
a k<eO0+1=1 
& n[5] = 1 
forg=6,k>0 
& P(1 + 1] = P[6] 
. ke14+1=2 
& n[6] = 2 











wl | of of a[ofi]e2 | 





Naive string matching algorithm : 
The Naive approach simply test all the possible placement of pattern 
P[1.. m] relative to text T[1..n]. Specifically, we try shifts s = [0, 1, 
...., 7 —m], successively and for each shift, s, compare T[s + 1..s + 
m|] to P[1.. m]. 
The Naive string matching procedure can be interpreted graphically 
as asliding a pattern P[1.. m] over the text T[1 .. m] and noting for 
which shift all of the characters in the pattern match the 
corresponding characters in the text. 
Naive string matcher (T, P) 
n < length [T] 
m < length [P] 
for s < 0 ton—m do 

Jel 
while j < m and T|s +] = Ply] do 
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9 OND 


J<jti 
if j > m then 
return valid shift s 
return no valid shift exist //7.e., there is no substring of T matching 
P. 


b. Explain approximation and randomized algorithms. 


Approximation algorithm : 

An approximation algorithm is a way of dealing with NP- 
completeness for optimization problem. This technique does not 
guarantee the best solution. 

The best of an approximation algorithm is to come as close as possible 
to the optimum value in a reasonable amount of time which is at 
most polynomial time. 

Let c(i) be the cost of solution produced by approximate algorithm 
and c*(z) be the cost of optimal solution for some optimization 
problem instance i. 

For minimization and maximization problem, we are interested in 
finding a solution of a given instance i in the set of feasible solutions, 
such that c(i)/c*(i) and c*(i)/ c(i) be as small as possible respectively. 
We say that an approximation algorithm for the given problem 
instance i, has a ratio bound of p(n) if for any input of size n, the 
cost c of the solution produced by the approximation algorithm is 
within a factor of p(n) of the cost c* of an optimal solution. That is 
max(c(i) / c*(Z), e*(t) / c(i)) < p(n) 

The definition applies for both minimization and maximization 
problems. 

p(n) is always greater than or equal to 1. If solution produced by 
approximation algorithm is true optimal solution then clearly we 
have p(n) = 1. 

Randomized algorithm : 

A randomized algorithm is defined as an algorithm that is allowed 
to access a source of independent, unbiased bits and it is then 
allowed to use these random bits to influence its computation. 
An algorithm is randomized if its output is determined by the 
input as well as the values produced by a random number 
generator. 

A randomized algorithm makes use of a randomizer such as a 
random number generator. 

The execution time of a randomized algorithm could also vary 
from run to run for the same input. 

The algorithm typically uses the random bits as an auxiliary input 
to guide its behaviour in the hope of achieving good performance 
in the “average case”. 

Randomized algorithms are particularly useful when it faces a 
malicious attacker who deliberately tries to feed a bad input to the 


algorithm. 
OOO 
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Time : 3 Hours Max. Marks : 70 


Note: 1. Attempt all sections. Ifrequire any missing data; then choose 
suitable. 
2. Anyspecial paper specific instruction. 


Section-A 


— 
: 


Attempt all questions in brief : (2 x 10 = 20) 
a. Rank the following by growth rate : 


n, 2 log Jn , log n, log (log n), log? n, (log n)'°8", 4, (3/2)", n! 


b. Prove that if n > = 1, then for any n-key B-tree of height h 
and minimum degree ¢ > = 2, h < = log, ((n + 1)/2). 


c. Define principle of optimality. When and how dynamic 
programming is applicable ? 


d. Explain application of graph colouring problem. 


e. Compare adjacency matrix and linked adjacency lists 
representation of graph with suitable example / diagram. 


f. What are approximation algorithms ? What is meant by 
p(n) approximation algorithms ? 


g. What do you mean by stability of a sorting algorithm ? 
Explain its application. 


SECTION-B 


2. Attempt any three of the following : (7x3 =21) 
a. Use arecursion tree to give an asymptotically tight solution 
to the recurrence T(n) = T(an) + T((1 - a)n) + en, where a is 
a constant in the range 0 < a <1 and c > 0 is also a constant. 
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b. 


Define BNP, NP hard and NP complete problems. Prove that 
travelling salesman problem is NP complete. 


Consider the weight and values of item listed below. Note 
that there is only one unit of each item. The task is to pick 
a subset of these items such that their total weight is no 
more than 11 kgs and their total value is maximized. 
Moreover, no item may be split. The total value of items 
picked by an optimal algorithm is denoted by Vopts A greedy 
algorithm sorts the items by their value-to-weight rations 
in descending order and packs them greedily, starting from 
the first item in the ordered list. The total value of items 
picked by the greedy algorithm is denoted by Vor Find 


the value of Vest - Voveedy* 


eedy* 














Insert the following key in a 2-3-4 B-tree : 
40, 35, 22, 90, 12, 45, 58, 78, 67, 60 and then delete key 35 and 22 
one after other. 


Prove that the weights on the edge of the connected 
undirected graph are distinct then there is a unique 
minimum spanning tree. Give an example in this regard. 
Also discuss prim’s minimum spanning tree algorithm in 
detail. 


SECTION-C 


Attempt any one part of the following : (10x 1=10) 
The recurrence T(n) = 7T(n/3) + n? describes the running 
time of an algorithm A. Another competing algorithm B 
has a running time of S(n) = a S(n/9) + n?. What is the 
smallest value of a such that B is asymptotically faster 
than A ? 


How will you sort following array A of element using heap 
sort: A = (23, 9, 18, 45, 5, 9, 1, 17, 6). 


Attempt any one part of the following : (10x 1=10) 
Explain the different conditions of getting union of two 
existing binomial heaps. Also write algorithm for union of 
two binomial heaps. What is its complexity ? 
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b. 


an 


Insert the elements 8, 20, 11, 14, 9, 4, 12 in a Red-Black tree 
and delete 12, 4, 9, 14 respectively. 


Attempt any one part of the following : (10x 1=10) 
When do Dijkstra and the Bellman Ford algorithm both fail 
to find a shortest path ? Can Bellman Ford detect all 
negative weight cycles in a graph ? Apply Bellman Ford 
algorithm on the following graph : 


Source 
vertex 





Fig. 1. 


Given an integer x and a positive number n, use divide and 
conquer approach to write a function that computes x” with 
time complexity O(log 7). 


Attempt any one part of the following : (10x 1=10) 
Solve the subset sum problem using backtracking, where 
n =4, m = 18, w[4] = {5, 10, 8, 13}. 


Give Floyd-Warshall algorithm to find the shortest path 
for all pairs of vertices in a graph. Give the complexity of 
the algorithm. Explain with example. 


Attempt any one part of the following : (10x 1=10) 
What is the application of Fast Fourier Transform (FFT) ? 
Also write the recursive algorithm for FFT. 


Give a linear time algorithm to determine if a text T is a 


cycle rotation of another string T. For example : RAJA and 
JARA are cyclic rotations of each other. 


OOO 
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Note: 


_ 
: 


SOLUTION OF PAPER (2018-19) 


1. Attempt all sections. Ifrequire any missing data; then choose 
suitable. 
2. Anyspecial paper specific instruction. 


Section-A 


Attempt all questions in brief : (2x 10 = 20) 


a. Rank the following by growth rate : 


Ans. 


Ans. 


wONnre 


n, 2 log Jn, log n, log (log n), log? n, (log n)'°S”, 4, (3/2)", n! 


- Rank in increasing order of growth rate is given as : 


4, log n, log (log n), log” n, (log n)log n, log n, 2 log Jn sn, nt, (3) 


Prove that if n > = 1, then for any n-key B-tree of height h 
and minimum degree f > = 2, h < = log, ((n + 1)/2). 

Proof: 

The root contains at least one key. 

All other nodes contain at least t— 1 keys. 

There are at least 2 nodes at depth 1, at least 2t nodes at depth 2, at 
least 2t'~! nodes at depth i and 2t’~! nodes at depth h. 

h 


n2>1+(t-1) 





7 (en) 
2t* 142-1 = 2th—1 
i=1 , ( t— 1 ) 

So t? < (n + 1)/2 as required. 
Taking log both sides we get, 


h < log, (n + 1)/2 


Define principle of optimality. When and how dynamic 
programming is applicable ? 

Principle of optimality : Principle of optimality states that in an 
optimal sequence of decisions or choices, each subsequence must 
also be optimal. 

Dynamic programming is mainly applicable where the solution of 
one sub-problem is needed repeatedly. In this procedure, the 
solutions of sub-problems are stored in a table, so that there is no 
need to re-compute the sub-problems and can be directly accessed 
from the table if required. 


Explain application of graph colouring problem. 
Application of graph colouring problem : 
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1. Sudoku: Sudoku is a variation of graph colouring problem where 
every cell represents a vertex. There is an edge between two vertices 
if they are in same row or same column or same block. 

2. Register allocation : In compiler optimization, register allocation 
is the process of assigning a large number of target program variables 
onto a small number of CPU registers. This problem is also a graph 
colouring problem. 

3. Bipartite graphs : We can check if a graph is bipartite or not by 
colouring the graph using two colours. If a given graph is 
2-colourable, then it is bipartite, otherwise not. 

4. Map colouring : Geographical maps of countries or states where 
no two adjacent cities cannot be assigned same colour. 


e. Compare adjacency matrix and linked adjacency lists 
representation of graph with suitable example / diagram. 





S. No. Adjacency matrix Linked adjacency list 
1. An adjacency matrix is a| Linked adjacency list is a 
square matrix used to | collection of unordered lists used 
represent a finite graph. to represent a finite graph. 
2: The elements of the matrix | Each list describes the set of 


indicate whether pairs of | adjacent vertices in the graph. 
vertices are adjacent or not in 

















the graph. 
3. Space complexity in the worst | Space complexity in the worst 
case is O(| V|?). case is O(|V|+|E]). 





For example : Consider the graph : 





Using adjacency matrix : Using adjacency list : 
ih toed TT > 
2/0 1010 [il 5 
3/0 0101 he [4] #421 | 
alr 0010 (4] +1717 


f. What are approximation algorithms ? What is meant by 
p(n) approximation algorithms ? 
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Ans: Approximation algorithm : An approximation algorithm is a 
way of dealing with NP-completeness for optimization problem. 


This technique does not guarantee the best solution. 

p(n) approximation algorithm : A is a p(n) approximate 
algorithm if and only if for every instance of size n, the algorithm 
achieves an approximation ratio of p(n). It is applied to both 
maximization (0 < C(i) < C*(z)) and minimization (0 < C* (i) < C(z)) 
problem because of the maximization factor and costs are positive. 
p(n) is always greater than 1. 


g. What do you mean by stability of a sorting algorithm ? 

Explain its application. 

Ans: Stability of a sorting algorithm : Let A be an array, and let < be 
a strict weak ordering on the elements of A. 
Sorting algorithm is stable if : 
i<jand Ali] =Alj] i.e., Ali] comes before Aly]. 
Stability means that equivalent elements retain their relative 
positions, after sorting. 
Application : One application for stable sorting algorithms is sorting 
a list using a primary and secondary key. For example, suppose we 
wish to sort a hand of cards such that the suits are in the order 
clubs, diamonds, hearts, spades and within each suit, the cards are 
sorted by rank. This can be done by first sorting the cards by rank 
(using any sort), and then doing a stable sort by suit. 


SECTION-B 


2. Attempt any three of the following : (7x3 =21) 
a. Use arecursion tree to give an asymptotically tight solution 
to the recurrence T(n) = T(an) + T((1 - a)n) + en, where a is 
a constant in the range 0 < a <1 and c > 0 is also a constant. 


Ans: T(n) =T(an) + T((1—a)n) + cn 
Recursion tree : 


a (1 = a)en ———————___» cn 
ca“n c(l—a)an cl-a)an c(l-a)an — » cn 
i. 2 I fen 

e e e e e e 
e e e e e e 
e e e e e e 
e 
T(1) T(1) T(1) T(1) (k + 1) times 


Assuming T(1)=1 
So c(l-wkn=1 


1 ( : 
cn = ———_ =| ———_ 
(-a)* l-a 
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So, 


Ans. 


1 
log (n) = k log (4) 


l-a 
1 
k= 08 cn = = log , (cn) 
] l-a 
leery 
Totalcost=cn+cn+.... (k +1) times = cn(k + 1) 
_ log , (cn) 
=cn x = 


l-a 


l-a l-a 


Time complexity = ae log , =) 7 ld log | 

Define BNP, NP hard and NP complete problems. Prove that 
travelling salesman problem is NP complete. 

P (BNP) : Class P are the problems which can be solved in 
polynomial time, which take time like O(n), O(n), O(n?). 
Example : Finding maximum element in an array or to check 
whether a string is palindrome or not. So, there are many problems 
which can be solved in polynomial time. 

NP : Class NP are the problems which cannot be solved in 
polynomial time like TSP (travelling salesman problem). 
Example : Subset sum problem is best example of NP in which 
given a set of numbers, does there exist a subset whose sum is 
zero, but NP problems are checkable in polynomial time means 
that given a solution of a problem, we can check that whether the 
solution is correct or not in polynomial time. 

NP-complete : The group of problems which are both in NP and 
NP-hard are known as NP-complete problem. 

Now suppose we have a NP-complete problem RF and it is reducible 
to Q then Q is at least as hard as R and since R is an NP-hard 
problem, therefore Q will also be at least NP-hard, it may be NP- 
complete also. 

NP hard and NP complete: 

We say that a decision problem P, is NP-hard if every problem in NP 
is polynomial time reducible to P... 

In symbols, 

P, is NP-hard if, for every P; « NP, P, te _> P, 

This does not require P, to be in NP. 

Highly informally, it means that P, is ‘as hard as’ all the problem in 
NP. 

If P, can be solved in polynomial time, then all problems in NP. 
Existence of a polynomial time algorithm for an NP-hard problem 
implies the existence of polynomial solution for every problem in 
NP. 
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Nr 


NP-complete problem : 

There are many problems for which no polynomial time algorithms 
is known. 

Some of these problems are travelling salesman problem, optimal 
graph colouring, the Knapsack problem, Hamiltonian cycles, integer 
programming, finding the longest simple path in a graph, and 
satisfying a Boolean formula. 

These problems belongs to an interesting class of problems called 
the “NP-complete” problems, whose status is unknown. 

The NP-complete problems are traceable i.e., require a super 
polynomial time. 

Proof: 

Part 1: TSP isin NP. 

Proof: 

Let a hint S be a sequence of vertices V = vj,..., v,,- 

We then check two things : 

First we check that every edge traversed by adjacent vertices is an 
edge in G, such that the sum of these edge weights is less than or 
equal to k. 

Secondly we check that every vertex in G is in V, which assures 
that every node has been traversed. 

We accept S if and only if S satisfies these two questions, otherwise 
reject. 

Both of these checks are clearly polynomial, thus our algorithm 
forms a verifier with hint S, and TSP is consequently in NP. 

Part 2: TSP is NP-Hard. 

Proof: 

To show that TSP is NP-Hard, we must show that every problem y 
in NP reduces to TSP in polynomial time. 

To do this, consider the decision version of Hamiltonian Cycle (HC). 
Take G=(V, E), set all edge weights equal to 1, and let k = |V|=n, 
that is, k equals the number of nodes in G. 

Any edge not originally in G then receives a weight of 2 (traditionally 
TSP is ona complete graph, so we need to add in these extra edges). 
Then pass this modified graph into TSP, asking if there exists a tour 
on G with cost at most k. If the answer to TSP is YES, then HC is 
YES. Likewise if TSP is NO, then HC is NO. 

First direction : HC has a YES answer => TSP has a YES answer. 
Proof: 

If HC has a YES answer, then there exists a simple cycle C that 
visits every node exactly once, thus C has n edges. 

Since every edge has weight 1 in the corresponding TSP instance 
for the edges that are in the HC graph, there is a Tour of weight n. 
Since k =n, and given that there is a tour of weight n, it follows that 
TSP has a YES answer. 

Second direction : HC has a NO answer => TSP has a NO answer. 
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Proof : 

1. If HC has a NO answer, then there does not exist a simple cycle C 
in G that visits every vertex exactly once. Now suppose TSP has a 
YES answer. 

2. Then there is a tour that visits every vertex once with weight at 
most k. 

3. Since the tour requires every node be traversed, there are n edges, 
and since k =n, every edge traversed must have weight 1, implying 
that these edges are in the HC graph. Then take this tour and 
traverse the same edges in the HC instance. This forms a 
Hamiltonian Cycle, a contradiction. 

This concludes Part 2. Since we have shown that TSP is both in NP 
and NP-Hard, we have that TSP is NP-Complete. 


ce. Consider the weight and values of item listed below. Note 
that there is only one unit of each item. The task is to pick 
a subset of these items such that their total weight is no 
more than 11 kgs and their total value is maximized. 
Moreover, no item may be split. The total value of items 


picked by an optimal algorithm is denoted by Von A greedy 


algorithm sorts the items by their value-to-weight rations 
in descending order and packs them greedily, starting from 
the first item in the ordered list. The total value of items 
picked by the greedy algorithm is denoted by Ve. 


the value of Vopt - Voveedy* 


aay Find 














Item Ww Vv 

















Rt 
wo 
S 
on 
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Ans. 


Total weight W=11lkg 
I, is picked soW= 11-2=9kg 
I, cannot picked 10 > 9 
I, is picked, W= 9-4 =5kg 
I, cannot be picked 7 > 5 
I, and I, are picked so 
Vireeay = Vy) + Vl) = 24 + 20 = 44 
For Vopt : For calculating Vopt we use 0/1 knapsack problem, so only 
item 1 is picked. Hence, Vv. =60 
So, V..-V.__., = 60-44 =16 


Insert the following key in a 2-3-4 B-tree : 
40, 35, 22, 90, 12, 45, 58, 78, 67, 60 and then delete key 35 and 22 
one after other. 


In 2-3-4 B-trees, non-leaf node can have minimum 2 keys and 
maximum 4 keys so the order of tree is 5. 


Insert 40, 35, 22, 90: 
| 22 | 35 | 40 | 90 | 
Insert 12: 
| 40 | 90 | 

Insert 45, 58: 

[| 40 | 45 | 58 | 90 | 
Insert 78: 

| 78 | 90 | 
Insert 67, 60: 
| 60 | 67 | 78 | 90 | 

Delete 35: 

(60 | 67 | 78 [90] 
Delete 22: 


[60 [67 | 78 | 90) 
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e. 


Prove that the weights on the edge of the connected 
undirected graph are distinct then there is a unique 
minimum spanning tree. Give an example in this regard. 
Also discuss prim’s minimum spanning tree algorithm in 
detail. 

Proof : 

Let we have an algorithm that finds an MST (which we will call A) 
based on the structure of the graph and the order of the edges 
when ordered by weight. 

Assume MST A is not unique. 

There is another spanning tree with equal weight, say MST B. 
Let e1 be an edge that is in A but not in B. 

Then, B should include at least one edge e2 that is not in A. 
Assume the weight of e1 is less than that of e2. 

As Bisa MST, {e1} UB must contain a cycle. 

Replace e2 with e1 in B yields the spanning tree {e1} U B — {e2} 
which has a smaller weight compared to B. 

This contradicts that B is not a MST. 

So, MST of undirected graph with distinct edge is unique. 
Example : 





Fig. 1. 
Step 1: Arrange the edge of graph according to weight in ascending 
order. 

















Edges Weight Edge Weight 
12 1 14 7 
13 2 35 8 
46 3 
25 4 
36 5 
56 6 

















Step 2 : Now draw the vertices as given in graph, 
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So © 
© 


Now draw the edge according to the ascending order of weight. If 
any edge forms cycle, leave that edge. 


eo 

@) 
Step4: © © 
of @ 
Step5: © © 
of @ 
Step6: © © 


©) _ 


(x)= 
(2) 
(+) 
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3. 
a. 


Ans. 


Step7: 





All the remaining edges, such as: 14, 35, 56 are rejected because 
they form cycle. 

All the vertices are covered in this tree. So, the final tree with 
minimum cost of given graph is 





Prim’s algorithm : 

First it chooses a vertex and then chooses an edge with smallest 
weight incident on that vertex. The algorithm involves following 
steps: 

Step 1: Choose any vertex V, of G. 

Step 2 : Choose an edge e, =V,V, of Gsuch that V,# V, and e, has 
smallest weight among the edge e of G incident with V,. 

Step 3 :If edges e,, ea are , é; have been chosen involving end 
points V,, Vo, veces Vip choose an edge e,,,= =VV, with V;= {V, 

Vi and V, ¢@ tv, designers V,,,} such that e, wihas amaltcst 
weight among tie edges ‘of Gwith precisely one end: a AV 4 sssedsscszeezis 
Vial 

Step 4 :Stop after n — 1 edges have been chosen. Otherwise goto 
step 3. 


SECTION-C 


Attempt any one part of the following : (10x 1=10) 
The recurrence T(n) = 7T(n/3) + n? describes the running 
time of an algorithm A. Another competine algorithm B 
has a running time of S(n) = a S(n/9) + n2. What is the 
smallest value of a such that B is asymptotically faster 
than A ? 

Given that : 


T(n) = (2) +n? A) 
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Ans. 


S'(n) = as'() +n? mes 
Here, eq. (1) defines the running time for algorithm and eq. (2) defines 
the running time for algorithm B. Then for finding value ofa for which B 


is asymptotically faster than A we find asymptotic notation for the 
recurrence by using Master’s method. 


Now, compare eq. ) with T(n) = ar(*) + fn) 
we get, a= 7, b=3 
fin) = n? 


nose = nts” = 7281 


Now, apply cases of Master’s, theorem as : 


Case 3: fn) = O (nl"**) 


=> fn) =O (ni.77 +e) 

= fin) = O (nh-77+ 0.23) 

> fin) = O (n?) 

Hence, case 3 of Master’s theorem is satisfied. 
Thus, T(n) = 0 fin) 

= T(n) = 0 (n?) 


Since recurrence (1) is asymptotically bounded by 0-notation which 
is used to show optimum time we have to show that recurrence 
given by eq. (2) is bounded by Q-notation which shows minimum 
time (best case). 

For the use satisfy the case 2 of Master theorem, Guess a = 81 


S'(n) = fn) = 81 (Zan 
=| a=81, b=9 
fin) = 78981 
fin) = Q(n'**) = Q(n?) 
Hence, case 2 of Master’s theorem is satisfied. 


> T(n) = 0 (n'®* log n) 

=> T(n) = 0 (n? log n) 

Therefore, this shows that B is asymptotically faster than A when 
a=8l. 


How will you sort following array A of element using heap 
sort : A = (23, 9, 18, 45, 5, 9, 1, 17, 6). 


Given array : | 23] 9 [18/45] 5 | 9 | 1 [17] 6 | 


First we call Build-Max heap 
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heap size [A] =9 





so i = 4to 1 call MAX HEAPIFY (A, i) 
i.e., first we call MAX HEAPIFY (A, 4) 
All] = 7, Ali] = Al4] = 45, Alr] =6 
l<left [4)=2x4=8 
r<right[4]=2x4+1=9 
8 <9 and A[8] = 17 < 45 (False) 
Then, largest < 4. 
Similarly for i = 3, 2, 1 we get the following heap tree : 





Now i = 9 down to 2 and size = 10 — 1 =9 and call MAX HEAPIFY 
(A, 1) each time 
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Exchanging A[1] © A[9] 





OFO 
a OE 


Now call MAX HEAPIFY (A, 1) and 
Exchange A[1] and A[8], size =9-1=8 


| | | | | | | [23] 45) 
Now, call MAX HEAPIFY (A, 1), exchange A[1] and A[4] and size = 
5-1=4 


J _ oe 


6 y 
| | | [9] 9 f17]1s] 23] 45] 
Now, call MAX HEAPIFY (A, 1), exchange A[1] and A[3] and size = 
4-1=83 


| | [69] 9 }i7{ is] 23] 45) 


Exchange A[1] and A[2] size 3-1=2 


Q+G?+o 


| [5] 6] 9] 9]17] 18} 23] 45] 
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The sorted array 


ras] 6] 9 [9 [ivi [23] 35] 


Now call MAX HEAPIFY (A, 1) and exchange A[1] and A[7] 
ag @) 
—» 
(YG CY OD, 
SOG WY § 06 B 


Now call MAX HEAPIFY (A, 1) and size = 7 — 1 = 6 exchange A[1] 
and A[6] 


Exchange A[1] and A[5] and size =6—-1=5 


ate 


Attempt any one part of the following : (10 x 1=10) 
a. Explain the different conditions of getting union of two 

existing binomial heaps. Also write algorithm for union of 
two binomial heaps. What is its complexity ? 

Ans: There are four cases/conditions that occur while 

performing union on binomial heaps. 

Case 1 : When degree[x] # degree[next-x] = degree [sibling[next- 

x]], then pointers moves one position further down the root list. 





> 


sibling 
prev-x x  next-x [next-x] prev-X x next-x 
RA RAR ARR AR 
AN LX 2X £S TX GS Go HS 
By Bh Casel By B, 
(a) (b) 
Fig. 2. 


Case 2: It occurs when x is the first of three roots of equal degree, 
that is, degree[x] = degree[next-x] = degree[sibling[next-x]], then 
again pointer move one position further down the list, and next 
iteration executes either case 3 or case 4. 


sibling 
prev-x x next-x  [next-x] prev-X x next-x 
---&(a}—_>(b} $+ ©—>@_ --->@-—- 0) © © @® 
eX J Ly LN LS ZS. LS Zs 
By By By Case 2 By By By 
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Case 3 : If degree[x] = degree[next-x] # degree [sibling[next-x]] 
and key[x] < key[next-x], we remove next-x from the root list and 
link it to x, creating B,,, tree. 


sibling 
prev-x x next-x _ [next-x] prev-x x next-x 


key [x] = key [next-x] 
(a) 





Fig. 4. 
Case 4 : degree[x] = degree[next-x] + degree[sibling|next-x] and 
key[next-x] < key x, we remove x from the root list and link it to 
next-x, again creating a B,,,, tree. 


sibling 
prev-x x next-x _—_ [next-x] prev-x x next-x 
-t@—-+-D—+- OO --+@--+O-- 
LS eS. LS LS iia 
By Bx Bh Case 4 G) B, B. 
key [x] > key [next-x] J \ 
By, 
Wk 
(a) But 
(b) 
Fig. 5. 


Algorithm for union of binomial heap: 

1. The BINOMIAL-HEAP-UNION procedure repeatedly links binomial 
trees where roots have the same degree. 

2. The following procedure links the B, , tree rooted at node to the 
B,_, tree rooted at node z, that is, it makes z the parent of y. Node z 
thus becomes the root of a B, tree. 

BINOMIAL-LINK (y, z) 

i ply] <z 

ii, sibling [y] < child[z] 

iii. child[z] < y 

iv. degree[z] < degree[z] + 1 

3. The BINOMIAL-HEAP-UNION procedure has two phases : 

a. The first phase, performed by the call of BINOMIAL-HEAP- 
MERGE, merges the root lists of binomial heaps H, and H, 
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into a single linked list H that is sorted by degree into 
monotonically increasing order. 

b. The second phase links root of equal degree until at most one 
root remains of each degree. Because the linked list His sorted 
by degree, we can perform all the like operations quickly. 

BINOMIAL-HEAP-UNION(H,, H,) 

H<« MAKE-BINOMIAL-HEAP ( ) 

head[H] < BINOMIAL-HEAP-MERGE(H,, H,) 

Free the objects H, and H, but not the lists they point to 

if head[H] = NIL 

then return H 

prev-x < NIL 

x < head[H] 

next-«x < sibling|[x] 

while next-x + NIL 

do if (degree[x] + degree[next-x]) or 

(sibling[next-x] + NIL and degree[sibling[next-x]] = degree[x]) 


. then prev-x <x => case 1 and 2 
x < next-«x => case 1 and 2 
else if key[x] < key[next-x] 

. then siblinglx] < sibling[next-x] => case 3 

. BINOMIAL-LINK(next-x, x) => case 3 

. else if prev-x« = NIL 

=> case 4 

. then head[H] < next-x 

=> case 4 

. else sibling|prev-x] < next-x => case 4 

. BINOMIAL-LINK(x, next-x) => case 4 

. x <— next-x« => case 4 

. next-x < sibling[x] 

. return H 


BINOMIAL-HEAP-MERGE(. pH. 2) 
a < head[H,] 

b < head[H,] 

head[H,] < min-degree (a, b) 
if head[H,] = NIL 

return 

if head[H,] =b 

thenb<a 

a < head[H,] 

while b NIL 

do if sibling[a] = NIL 


. then siblingla] <b 

. return 

. else if degree [sibling[a]] < degree[b] 
. thena < sibling[a] 

. elsec < sibling|[d] 
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16. 
17. 
18. 
19. 


Ans. 


sibling[b] < siblingla] 

sibling[a] <b 

a < sibling[a] 

bec 

Time complexity of union of two binomial heap is O(log 7). 


Insert the elements 8, 20, 11, 14, 9, 4, 12 in a Red-Black tree 
and delete 12, 4, 9, 14 respectively. 


Insert 8: 
B 


B 
OF 
20 
Insert 11 : Since, parent of node 11 is red. Check the colour of 


uncle of node 11. Since uncle of node 11 is nil than do rotation and 
recolouring. 


B 
Left B 
ey &) rotation (11) R 
— R- ~R 
@) (3) @ 
ek 


Insert 14: Uncle of node 14 is red. Recolour the parent of node 14 
i.e., 20 and uncle of node 14 i.e., 8. No rotation is required. 


B Bl R—-——~> pB B, B 
(3) 29) (8) 20 
RQ) RQY 


Insert 9 : Parent of node 9 is black. So no rotation and no 
recolouring. 


Insert 20: 








Insert 4 : Parent of node 4 is black. So no rotation and no 
recolouring. 
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Insert 12 : Parent of node 12 is red. Check the colour of uncle of 
node 12, which is nil. So do rotation and recolouring. 





Delete 14 : Node 14 is internal node replace node 14 with node 20 
and do not change the colour. 
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5. Attempt any one part of the following : (10 x 1=10) 
a. When do Dijkstra and the Bellman Ford algorithm both fail 


Ans. 


to find a shortest path ? Can Bellman Ford detect all 
negative weight cycles in a graph ? Apply Bellman Ford 
algorithm on the following graph : 


Source 





Dijkstra algorithm fails to find a shortest path when the graph 
contains negative edges. 


Bellman Ford algorithm fails to find a shortest path when the graph 
contain negative weight cycle. 

No, Bellman Ford cannot detect all negative weight cycle in a graph. 
Numerical : 
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Ans. 


S 


Ans. 





Given an integer x and a positive number n, use divide and 
conquer approach to write a function that computes x” with 
time complexity O(log n). 

Function to calculate x” with time complexity O(log n) : 
int power(int x, unsigned int y) 

{ 

int temp; 

iffy == 0) 

return 1; 

temp = power(x, y/2); 

if (y%2 == 0) 

return temp * temp; 

else 

return x * temp * temp; 


} 


Attempt any one part of the following : (10 x 1= 10) 
Solve the subset sum problem using backtracking, where 
n=4,m = 18, w[4] ={5, 10, 8, 13}. 

n=A4 

m=18 

w{4} = {5, 10, 8, 13} 

Sorted order : w{4} = {5, 8, 10, 13} 
Now we construct state-space tree. 
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PwN rE 


I = Include 
E = Exclude 





First Subset S, = {5, 13} 
Similarly, S, = {8, 10} 


Give Floyd-Warshall algorithm to find the shortest path 
for all pairs of vertices in a graph. Give the complexity of 
the algorithm. Explain with example. 

Floyd-Warshall algorithm : 

Floyd-Warshall algorithm is a graph analysis algorithm for finding 
shortest paths in a weighted, directed graph. 

A single execution of the algorithm will find the shortest path 
between all pairs of vertices. 

The algorithm considers the “intermediate” vertices of a shortest 
path, where an intermediate vertex of a simple path p = (v,, Ug, ..., 
U,,) is any vertex of p other than v, or v,,, that is, any vertex in the 
set {Up, Ug, ..) Up, 4} 

Let the vertices of G be V= {1, 2, ..., n}, and consider a subset {1, 2, 
..., k} of vertices for some k. 

For any pair of vertices i,j ¢ V, consider all paths from i to j whose 
intermediate vertices are all drawn from {1, 2,...,k}, and let p be a 
minimum-weight path from among them. 


Let d; be the weight of a shortest path from vertex i to vertex j 


with all intermediate vertices in the set {1, 2,..., R}. 
A recursive definition is given by 


i Ww; if k=0 
v | mind, dt? +d?) if R21 
Floyd-Warshall (W) : 
n < rows [W] 
Do —W 
fork<1l1ton 

do fori<-lton 
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5. do forj< lton 
6. do dj? <— min(d?, di? + dr?) 
7. ra@urn D™ 


Time complexity of Floyd-Warshall algorithm is O(n). 
Example : 





k . k-1 k-1 k-1 
di) = mind! ore A eae dy, zi 

(k-1) ; (k-1) (k—-1) (k-1) 
: if d;; <djy + dy 


(Rl) v0 A(R-D) S g(R-D (RD) 
my; i dy > dip’ + dy 














03 8 w -4 [NIL 1 1 4NIL1 
o 0 © 1 7 NIL NIL NIL 2. 2 
D®=|0 4 0 © olsn=|/NIL 3 NIL NIL NIL 
20-5 0 w 4 NIL 4. NIL NIL 
0 0 0 6 O [NIL NIL NIL 5 NIL| 
03 8 wo -4 NIL 1 1 NL1 7 
o 0 «© 1 7 NIL NIL NIL 2. 2 
DY=|0 4 0 © owlsn%=/NIL 3. NIL NIL NIL 
25 -5 0 -2 4 1 4 N11 
oo 0 6 O [NIL NIL NIL 5 NIL| 
03 8 4 -4) NIL 1 1 2 1 
o 0 wo 1 7 NIL NIL NIL 2 
D®=|0 4 O 5 11lj;n?=|NIL 3 NIL 2 2 
25-5 0 - 4 1 4 N11 
oo wo 6 O NIL NIL NIL 5 ~~ NIL 
0 3 8 4 -4) NIL 1 1 2 1 
o 0 1 7 NIL NIL NIL 2. 2 
D® = | w 05 lll;x®=|NIL 3 NIL 2 2 
2.21, —§ = 4 8 4 NIL1 
0 6 





NIL NIL NIL 5 NIL 
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. n<length [a] 


coe ON 


3 -1 4 -4) NIL 1 4 2 1 

0 -4 1 -1 4 NIL 4 2 1 

4 05 3);n%=/4 3 NIL 2 1 
-1 -5 0 -2 4 3 4 NIL 1 

5 16 O 4 3 4 5 NIL 

1-38 2 -4) NIL 3 4 5 1 

0 -4 1 -1 4 NIL 4 2 1 

4 05  38);n°=/4 3 NIL 2 1 
-1 -5 0 -2 4 3 4 NIL 1 

5 16 0 4 3 4 5 NIL 

Attempt any one part of the following : (10x 1=10) 


What is the application of Fast Fourier Transform (FFT) ? 
Also write the recursive algorithm for FFT. 

Application of Fast Fourier Transform : 

Signal processing. 

Image processing. 

Fast multiplication of large integers. 

Solving Poisson’s equation nearly optimally. 

Recursive algorithm : 

The Fast Fourier Transform (FFT) is a algorithm that computes a 
Discrete Fourier Transform (DFT) of n-length vector in O(n log n) 
time. 

In the FFT algorithm, we apply the divide and conquer approach 
to polynomial evaluation by observing that if n is even, we can 
divide a degree (n — 1) polynomial. 

A(x) =a) + ax + yx” t..+Q, 4 rl 


n 


into two degree (2 1 polynomials. 


2 n/2-1 
+. FG, 9X 
2 n/2-1 


+u.tQ, 4% 


Aly) watson ses 
=a, 3% + a5x 
Where A"! contains all the even index coefficients of A and A!!! 
contains all the odd index coefficients and we can combine these 
two polynomials into A, using the equation, 
A(x) =A!l (42) + xA 4! (x?) 

FFT (a, w): 


.(1) 


nis a power of 2. 
ifn=1 


. then return a 


0, e2niln 


x < x will store powers of o initially x = 1. 
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Ans. 


al — (ap, dy,...0,, na) 
all — (ay, G3, ... a, 1) 
yi < FFT(a, ody Recursive calls with w? as (n/2)** root of unity. 
yl — FFT(a", @?) 
for k — 0 to (n/2)-1 


. doy, < yl +x yi] 
Yevininy — ye ] — xyll 

Xe xO, 

. return y 


Line 2-3 represents the basis of recursion; the DFT of one element 
is the element itself. Since in this case 

Vo = Ay 01° =a) 1 =a, 

Line 6-7 defines the recursive coefficient vectors for the polynomials 
A and AM. @ = a, 


Line 8-9 perform the recursive DFT, ,. computations setting for 
n 
k=0,1,2,..., — -lice., 
2 


vy?) = All (@2*) ; yl = AM (@?') 
Lines 11-12 combine the results of the recursive DFT,,,. 
calculations. 
asics ++ ¥in/g)-1» Line 11 yields. 


Ye = Ye + One 
= AMl(o2*)+ ot AM(@2*) = A(o*) using equation (1) 
For y,,/9) Yona .Y,_p line 12 yields. 
Yim = 2108 9p! = +o? yf! brat = oh 
= Alo (w2*) + gb n/2) AM (@2) 
= AMl(@2* co) + bt r/?) AM? o”) [e wo” =1] 


= AlN (eg 2P Ht) gg) Au (@2**”) 


= A(@ht/2)) using equation (1) 


each k = 0, 1, 2, ...,(n/2) — 1. 
Thus, the vector y returned by the FFT algorithm will store the 
values of A(x) at each of the roots of unity. 


Give a linear time algorithm to determine if a text T is a 
cycle rotation of another string T. For example : RAJA 
and JARA are cyclic rotations of each other. 


Knuth-Morris-Pratt algorithm is used to determine if a text Tis a 
cycle rotation of another string T’. 
Knuth-Morris-Pratt algorithm for string matching : 
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SHBANSOAPWNE 


CONOaPwonr 


COMPUTE-PREFIX-FUNCTION (P) 
m < length [P] 
rli]<0 
k<0 
forg<2tom 
do while k > 0 and P [k + 1]  Plq] 
dok <x [hk] 
if P[k + 1] =P [q] 
thenk<k+1 
tiql<k 
return 7 
KMP-MATCHER calls the auxiliary procedure COMPUTE-PREFIX- 
FUNCTION to compute z. 
KMP-MATCHER (T, p) 
n < length [T] 
m < length [P] 
m< COMPUTE-PREFIX-FUNCTION (P) 
q<0 
fori<lton 
do while g > 0 and P [q + 1] # Tli] 
doqg< x lq 
if P [q +1] = TIi] 
theng<q+1 
ifqgq=m 


. then print “pattern occurs with shift” i —m 
. g<— ld 


OOO 
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(SEM. V) ODD SEMESTER THEORY 
EXAMINATION, 2019-20 
DESIGN AND ANALYSIS OF ALGORITHMS 





Time : 3 Hours Max. Marks : 100 


Note: Attempt all sections. If require any missing data; then choose 
suitably. 
Section-A 


re 


Attempt all questions in brief. (2x 7=14) 
a. How do you compare the performance of various 
algorithms ? 


b. Take the following list of functions and arrange them in 
ascending order of growth rate. That is, if function g(n) 
immediately follows function f(r) in your list, then it should 
be the case that f(n) is O(g(n)). 

f,(n) =n, f,(n) = V2", f,(n) =n + 10, f,(n) = 10n, f,(7) = 100n, 
and f,(n) = n” log n 


c. What is advantage of binary search over linear search? 
Also, state limitations of binary search. 


d. What are greedy algorithms ? Explain their characteristics ? 
e. Explain applications of FFT. 

f. Define feasible and optimal solution. 

g. What do you mean by polynomial time reduction ? 

Section-B 
2. Attempt any three of the following : (7x3 =21) 
a.i. Solve the recurrence T (n) = 2T(n/2) + n?2+2n+1 
ii. Prove that worst case running time of any comparison sort 


isQ (nlogn). 


b. Insert the following element in an initially empty RB-Tree. 
12, 9, 81, 76, 23, 43, 65, 88, 76, 32, 54. Now delete 23 and 81. 
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Cc. 


Sd 


an 


Define spanning tree. Write Kruskal’s algorithm or finding 
minimum cost spanning tree. Describe how Kruskal’s 
algorithm is different from Prim’s algorithm for finding 
minimum cost spanning tree. 


What is dynamic programming ? How is this approach 
different from recursion? Explain with example. 


Define NP-hard and NP-complete problems. What are the 
steps involved in proving a problem NP-complete ? Specify 
the problems already proved to be NP-complete. 


Section-C 


Attempt any one part of the following : (7x1=7) 
Among Merge sort, Insertion sort and quick sort which 
sorting technique is the best in worst case. Apply the best 
one among these algorithms to sort the list E, X, A, M, P, L, 
E in alphabetic order. 


Solve the recurrence using recursion tree method : 
T (n) =T (n/2) + T (n/4) + T (n/8) +0 


Attempt any one part of the following : (7x1=7) 
Using minimum degree “’ as 3, insert following sequence of 
integers 10, 25, 20, 35, 30, 55, 40, 45, 50, 55, 60, 75, 70, 65, 80, 85 
and 90 in an initially empty B-Tree. Give the number of 
nodes splitting operations that take place. 


Explain the algorithm to delete a given element in a binomial 
heap. Give an example for the same. 


Attempt any one part of the following : (7x1=7) 
Compare the various programming paradigms such as 
divide-and-conquer, dynamic programming and greedy 
approach. 


What do you mean by convex hull ? Describe an algorithm 
that solves the convex hull problem. Find the time 
complexity of the algorithm. 


Attempt any one part of the following : 

Solve the following 0/1 knapsack problem using dynamic 
programming P = {11, 21, 31, 33} w = {2, 11, 22, 15} c = 40, 
n=4, 
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b. Define Floyd Warshall algorithm for all pair shortest path 
and apply the same on following graph : 





7. Attempt any one part of the following : (7x1=7) 

a. Describe in detail Knuth-Morris-Pratt string matching 
algorithm. Compute the prefix function x for the pattern 
ababbabbabbababbabb when the alphabet is = = {a, b}. 


b. What is an approximation algorithm ? What is meant by 


p(n) approximation algorithms ? Discuss approximation 
algorithm for Travelling Salesman Problem. 


OOO 
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Note: 


ae 


SOLUTION OF PAPER (2019-20) 


Attempt all sections. If require any missing data; then choose 
suitably. 
Section-A 


Attempt all questions in brief. (2x 7=14) 


a. How do you compare the performance of various 


Ans. 


a 


Ans. 


algorithms ? 

To compare the performance of various algorithms first we measure 
its performance which depends on the time taken and the size of 
the problem. For this we measure the time and space complexity of 
various algorithms which is divided into different cases such as 
worst case, average case and best case. 


Take the following list of functions and arrange them in 
ascending order of growth rate. That is, if function g(n) 
immediately follows function f(7) in your list, then it should 
be the case that f(n) is O(g(n)). 

f,() =n", f,(n) = V2", f,(n) =n + 10, f,(n) = 10n, f,(2) = 100n, 
and f,(n) = n” log n 


 f,(2) = f(r) = f(r) < fp) < fg) < fhm) 


What is advantage of binary search over linear search? 
Also, state limitations of binary search. 

Advantages of binary search over linear search : 

Input data needs to be sorted in binary search but not in linear 
search. 

Linear search does the sequential access whereas binary search 
access data randomly. 

Time complexity of linear search is O(n) where binary search has 
time complexity O(log n). 

Limitation of binary search : 

List must be sorted. 

It is more complicated to implement and test. 


What are greedy algorithms ? Explain their characteristics ? 
Greedy algorithms: Greedy algorithms are shortsighted in their 
approach in the sense that they take decisions on the basis of 
information at hand without worrying about the effect these 
decisions may have in the future. 

Characteristics of greedy algorithm : 

Greedy algorithms are most efficient. 

For every instance of input greedy algorithms makes a decision 
and continues to process further set of input. 
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Ans. 


Ans. 


The other input values at the instance of decision are not used in 
further processing. 


Explain applications of FFT. 
Application of Fast Fourier Transform : 
Signal processing. 

Image processing. 

Fast multiplication of large integers. 

Solving Poisson’s equation nearly optimally. 


Define feasible and optimal solution. 


; Feasible solution : A feasible solution is a set of values for the 


decision variables that satisfies all of the constraints in an 
optimization problem. The set of all feasible solutions defines the 
feasible region of the problem. 

Optimal solution : An optimal solution is a feasible solution where 
the objective function reaches its maximum (or minimum) value. 


What do you mean by polynomial time reduction ? 


A polynomial time reduction is a method for solving one problem 
using another. For example, if a hypothetical subroutine solving 
the second problem exists, then the first problem can be solved by 
transforming or reducing it to inputs for the second problem and 
calling the subroutine one or more times. 


Section-B 


Attempt any three of the following : (7x3 =21) 


. Solve the recurrence T (n) = 2T(n/2) + n?2+2n+1 
ii. 


Prove that worst case running time of any comparison sort 
isQ (n log n). 


T (n) = 2T(n/2) +n? +2n+17~ 2T (2) +n? 


Compare it with T(n) = aT (2) + f(n) 

we have, a= 2,b=2, fn) =n? 

Now, we apply cases for Master’s theorem. 
780% = n'0822 =n 

This satisfies case 3 of Master’s theorem. 


= fin) Q(nl82+#) a (n1*£) 


Q (ni th where E = 1 
= Q (n?) 
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Ans. 


2 
Again 2A) <c fin?) AD) 
eq. (1) is true for c = 2 
=> T(n) = 0 (Ain)) 
> T(n) = 0 fin?) 


Let T(n) be the time taken by merge sort to sort any array of n 
elements. 


Therefore, T(n) = 7(|2) + (|=) + g(n) 


where g(n) € O(n) 
This recurrence, which becomes : 


T(n) = 2T (2) + g(n) 


when n is even is a special case of our general analysis for divide- 
and conquer algorithms. 


Compare the above given recurrence with T(n) = aT (2) + f(n) 


we get a=2 
b=2 
fin) = g(n) 
Now we find, n'€o% _ yloe22 _ plin 
> fin) = O(n) 


i.e., case 2 of Master’s theorem applied then 


T(n) = Q(nl8e4 log n) 
=> T(n) = Q (n log n) 
Hence, the worst case running time of merge sort is Q(n log n). 


Insert the following element in an initially empty RB-Tree. 
12, 9, 81, 76, 23, 43, 65, 88, 76, 32, 54. Now delete 23 and 81. 


Insert 12: 


Insert 9: 


Insert 81: 
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Insert 76: 


Insert 23: 
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Insert 32: 
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Insert 54: 








c. Define spanning tree. Write Kruskal’s algorithm or finding 
minimum cost spanning tree. Describe how Kruskal’s 
algorithm is different from Prim’s algorithm for finding 
minimum cost spanning tree. 

Ans: Spanning tree: 

1. A spanning tree of a graph is a subgraph that contains all the 

vertices and is a tree. 
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2. A spanning tree of a connected graph G contains all the vertices 
and has the edges which connect all the vertices. So, the number of 
edges will be 1 less the number of nodes. 

3. Ifgraphis not connected, i.e.,a graph with n vertices has edges less 
than n — 1 then no spanning tree is possible. 

4. A graph may have many spanning trees. 

Kruskal’s algorithm : 

i. Inthis algorithm, we choose an edge of G which has smallest weight 
among the edges of G which are not loops. 

ii. This algorithm gives an acyclic subgraph T of G and the theorem 
given below proves that T is minimal spanning tree of G. Following 
steps are required : 

Step 1 :Choose e,, an edge of G, such that weight ofe,, w(e,) is as 
small as possible and e, is not a loop. 

Step 2 :If edges e,, €y, ......... , e; have been selected then choose an 
edge e,,, not already chosen such that 

i. the induced subgraph 
Gite, ..... e;,,}] is acyclic and 

ii. w(e,,,) is as small as possible 
Step 3 :If G has n vertices, stop after n — 1 edges have been chosen. 
Otherwise repeat step 2. 

If G be a weighted connected graph in which the weight of the 
edges are all non-negative numbers, let T be a subgraph of G 
obtained by Kruskal’s algorithm then, T is minimal spanning tree. 
Difference: 
S. No. Kruskal’s algorithm Prim’s algorithm 

1. Kruskal’s algorithm | Prim’s algorithm initializes with a 
initiates with an edge. node. 

2. Kruskal’s algorithm selects | Prim’s algorithms span from one 
the edges in a way that the | node to another. 
position of the edge is not 
based on the last step. 

3. Kruskal’s can be used on| In Prim’s algorithm, graph must be 
disconnected graphs. a connected graph. 

4, Kruskal’s time complexity|Prim’s algorithm has a time 
in worst case is O(E log EF). |complexity in worst case of 

O(E log V). 
d. What is dynamic programming ? How is this approach 


Ans. 


different from recursion? Explain with example. 
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1. 


i) 


Dynamic programming is a stage-wise search method suitable for 
optimization problems whose solutions may be viewed as the result 
of a sequence of decisions. 
It is used when the sub-problems are not independent. 
Dynamic programming takes advantage of the duplication and 
arranges to solve each sub-problem only once, saving the solution 
(in table or something) for later use. 
Dynamic programming can be thought of as being the reverse of 
recursion. Recursion is a top-down mechanism i.e., we take a 
problem, split it up, and solve the smaller problems that are created. 
Dynamic programming is a bottom-up mechanism 1.e., we solve all 
possible small problems and then combine them to obtain solutions 
for bigger problems. 
Difference : 
In recursion, sub-problems are solved multiple times but in dynamic 
programming sub-problems are solved only one time. 
Recursion is slower than dynamic programming. 
For example : 
Consider the example of calculating n“* Fibonacci number. 
fibo(n) = fibo(n — 1) + fibo(n — 2) 
fibo(n — 1) = fibo(n — 2) + fibo(n — 3) 
fibo(n — 2) = fibo(n — 3) + fibo(n — 4) 





fibo(2) = fibo(1) + fibo(0) 
In the first three steps, it can be clearly seen that fibo(n — 3) is 
calculated twice. If we use recursion, we calculate the same sub- 
problems again and again but with dynamic programming we 
calculate the sub-problems only once. 


Define NP-hard and NP-complete problems. What are the 
steps involved in proving a problem NP-complete ? Specify 
the problems already proved to be NP-complete. 

NP-hard problem : 

We say that a decision problem P, is NP-hard if every problem in NP 
is polynomial time reducible to P... 

In symbols, 

P; is NP-hard if, for every P; < NP, P, > P. 

This does not require P, to be in NP. 

Highly informally, it means that P, is ‘as hard as’ all the problem in 
NP. 

If P, can be solved in polynomial time, then all problems in NP. 
Existence of a polynomial time algorithm for an NP-hard problem 
implies the existence of polynomial solution for every problem in 
NP. 
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Ans. 


Ans. 


PON 


NP-complete problem : 

There are many problems for which no polynomial time algorithms 
is known. 

Some of these problems are travelling salesman problem, optimal 
graph colouring, the Knapsack problem, Hamiltonian cycles, integer 
programming, finding the longest simple path in a graph, and 
satisfying a Boolean formula. 

These problems belongs to an interesting class of problems called 
the “NP-complete” problems, whose status is unknown. 

The NP-complete problems are traceable i.e., require a super 
polynomial time. 

Steps involved in proving a problem is NP-complete : 

Step 1 : Given a problem U, show that U is NP. 

Step 2: Select a known NP-complete problem V. 

Step 3 : Construct a reduction from V to U. 

Step 4: Show that the reduction requires polynomial time. 

List of NP-complete problems : 


3SAT 
Vertex-cover 
Clique 
Hamiltonian circuits. 
Section-C 
Attempt any one part of the following : (7x1=7) 


Among Merge sort, Insertion sort and quick sort which 
sorting technique is the best in worst case. Apply the best 
one among these algorithms to sort the list E, X, A, M, P, L, 
E in alphabetic order. 

Merge sort technique is best in worst case because of its time 
complexity O(n log n). 

Numerical : 

Given : E, X, A, M, P, L, E 

Pass 1: Merge each pair of element to obtain sorted list : 


[P [LIE 
After sorting each pair, we get 
[L | P| 
Pass 2: Merge each pair to obtain the list : 
[E| LP) 
Pass 3: Again merge the two sub arrays to obtain the list : 


[A [E/E [L| | P[ x] 


Solve the recurrence using recursion tree method : 
T (n) = T (n/2) + T (n/4) + T (n/8) +n 
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2 
T(n) = PR LeEan eer + log n times 
8 
= QO (n log n) 
a | ~, n 
7n 
oa 
log n 
2 
n 
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4, Attempt any one part of the following : (7x1=7) 
a. Using minimum degree @’ as 3, insert following sequence of 
integers 10, 25, 20, 35, 30, 55, 40, 45, 50, 55, 60, 75, 70, 65, 80, 85 
and 90 in an initially empty B-Tree. Give the number of 
nodes splitting operations that take place. 
Ans: Insert 10, 25, 20, 35: 


fio [20 [2] a5] 


Insert 30: 











20 | 30 | 40 





Insert 50, 55: 
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poo [020 EXE) 






Split 


\ Split 





Insert 60, 75: 


Split 








Insert 70, 65: 
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Split 


=> 
feo] 65 [70] 75) 





Number of nodes splitting operations = 9. 
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SONA AaroON 


Explain the algorithm to delete a given element in a binomial 
heap. Give an example for the same. 


7 Deletion of key from binomial heap: 


The operation BINOMIAL-HEAP-DECREASE (H, x, k) assigns a 
new key ‘Rk’ to a node ‘x’ in a binomial heap H. 
BINOMIAL-HEAP-DECREASE-KEY (H, x, k) 

if k > key [x] then 

Message “error new key is greater than current key” 

key [x] < k 

yex 

z¢P ly] 

While (z # NIL) and key [y] < key [z] 

do exchange key [y] < key [z] 

yew 

z<¢Ply] 

Deleting a key : The operation BINOMIAL-HEAP-DELETE 
(H, x) is used to delete a node x’s key from the given binomial heap 
H. The following implementation assumes that no node currently 
in the binomial heap has a key of — ~. 
BINOMIAL-HEAP-DELETE (H, x) 
BINOMIAL-HEAP-DECREASE-KEY (H, x, —) 
BINOMIAL-HEAP-EXTRACT-MIN(H) 

For example : Operation of Binomial-Heap-Decrease (H, x, k) on 
the following given binomial heap : 

Suppose a binomial heap H is as follows : 





The root x with minimum key is 1. x is removed from the root list of 
H.i.e., 
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Head[H] 





Now, the linked list of x’s children is reversed and set head|H'] to 
point to the head of the resulting list, i.e., another binomial heap H'. 





Now, call BINOMIAL-HEAP-UNION (H, H') to uniting the two 
binomial heaps H and H’. The resulting binomial heap is 





5. Attempt any one part of the following : (7x1=7) 

a. Compare the various programming paradigms such as 
divide-and-conquer, dynamic programming and greedy 
approach. 
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Ans. 

S. No. Divide and Dynamic Greedy 
conquer programming approach 
approach approach 

1. Optimizes by|Same as Divide and| Optimizes by 
breaking down a/|Conquer, but optimizes | making the best 
subproblem into | by caching the answers | choice at the 
simpler versions of | to each subproblem as | moment. 
itselfand using multi-|not to repeat the 
threading and | calculation twice. 
recursion to solve. 

2. Always finds the | Always finds the optimal | Does not always 
optimal solution, but | solution, but cannot | find the optimal 
is slower  than/|work onsmall datasets. | solution, but is 
Greedy. very fast. 

3. Requires some | Requires a lot of memory | Requires almost 
memory to | for tabulation. no memory. 
remember recursive 
calls. 

b. What do you mean by convex hull ? Describe an algorithm 
that solves the convex hull problem. Find the time 
complexity of the algorithm. 

Ans. 

1. The convex hull of a set S of points in the plane is defined as the 
smallest convex polygon containing all the points of S. 

2. The vertices of the convex hull of a set S of points form a (not 
necessarily proper) subset of S. 

3. To check whether a particular point p < S is extreme, see each 


possible triplet of points and check whether p lies in the triangle 
formed by these three points. 


Fig. 1. 


4. Ifp lies in any triangle then it is not extreme, otherwise it is. 


We denote the convex hull of S by CH(S). Convex hull is a convex 
set because the intersection of convex sets is convex and convex 
hull is also a convex closure. 
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> 


Ans. 


oars a P & 


Graham-Scan algorithm : 


The procedure GRAHAM-SCAN takes as input a set Q of points, 
where |Q| 23. It calls the functions Top(S), which return the point 
on top of stack S without changing S, and to NEXT-TO-TOP(S), 
which returns the point one entry below the top of stack S without 
changing S. 

GRAHAM-SCAN(Q) 

Let py be the point in Q with the minimum y-coordinate, or the 
leftmost such point in case of a tie. 


Let <p), Do; «+ P,,> be the remaining points in Q, sorted by polar 
angle in counter clockwise order around p, (if more than one point 
has the same angle remove all but the one that is farthest from p,). 


Top [S] <— 0 
PUSH (p,, 8) 
PUSH (p,,S) 
PUSH (p,, S) 
fori<-3tom 
do while the angle formed by points NEXT-To-TOP(S), Top(S), and 
p; makes a non left turn. 
do POP(S) 

PUSH (p,, S) 
return S 
Time complexity : 
The worst case running time of GRAHAM-SCAN is 

T(n) = O(n) + O(n log n) + O(1) + O(n) = OM log n) 

where n= |Q| 


Graham’s scan running time depends only on the size of the input 
it is independent of the size of output. 


Attempt any one part of the following : 
Solve the following 0/1 knapsack problem using dynamic 
programming P = {11, 21, 31, 33} w = {2, 11, 22, 15} c = 40, 
n=A, 
Numerical : 

w = {2, 11, 22, 15} 

c= 40 

p = {11, 21, 31, 33} 
Initially, 
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Item Ww; P; 
i, 2 11 
L 11 21 
i 22 31 
1, 15 33 
Taking value per weight ratio, i.e., p/w; 

Item Ww; v,/w,; DP; 
1, 2 11 22 
I, 11 21 232 
ia 22 31 682 
I, 15 33 495 











Now, arrange the value of p, in decreasing order. 
































Now, fill the knapsack according to decreasing value of p,. 

First we choose item J, whose weight is 22, then choose item I, 
whose weight is 15. Now the total weight in knapsack is 22 + 15 = 
37. Now, next item is I, and its weight is 11 and then again I,. So, we 
choose fractional part of it, i.e., 


The value of fractional part of I, is, 


232 
= cia x3 =63 


Thus, the maximum value is, 
= 682 + 495 + 63 = 1190 
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b. 


Define Floyd Warshall algorithm for all pair shortest path 
and apply the same on following graph : 





Fig. 2. 

Floyd Warshall algorithm : 
Floyd-Warshall algorithm is a graph analysis algorithm for finding 
shortest paths in a weighted, directed graph. 
A single execution of the algorithm will find the shortest path 
between all pairs of vertices. 
It does so in (V2) time, where V is the number of vertices in the 
graph. 
Negative-weight edges may be present, but we shall assume that 
there are no negative-weight cycles. 
The algorithm considers the “intermediate” vertices of a shortest 
path, where an intermediate vertex of a simple path p = (v,, Vg, ..., 
U,,) is any vertex of p other than v, or v,,, that is, any vertex in the 
set {Ug, Ugy +++3 Vip_y} 
Let the vertices ofG be V= {1, 2, ..., n}, and consider a subset {1, 2, 

., k} of vertices for some k. 
For any pair of vertices i, 7 < V, consider all paths from i to j whose 
intermediate vertices are all drawn from (1, 2,...,k}, and let p be a 
minimum-weight path from among them. 


Let ay be the weight of a shortest path from vertex i to vertex j 


with all intermediate vertices in the set {1, 2, ..., R}. 
A recursive definition is given by 


- W, ifk=0 
~ |min(d'”, dt? +d?) if R21 


Numerical : 


d= minid??, dt + dt) 


n® = 
Ni = 


y 


ho 1) if di 1) < di- 1) 7 di 1) 
ny 1) if ay 1) S dit 1) +d 1) 
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Ans. 


i) 


D® = 
4 |e 1 &t % @ 
5 (eo 4 eo @| 
3.4 «+5 
1fo 46 8 
2/309 6 * 
(1) 
=e |\'¢ 2 o a = 


D=316 3 0 2 2% 
a oe ee eee ae 


5/6 3 3 2 0O 








Now, if we find D®’, D® and D® there will be no change in the 
entries. 


Attempt any one part of the following : (7x1=7) 
Describe in detail Knuth-Morris-Pratt string matching 
algorithm. Compute the prefix function x for the pattern 
ababbabbabbababbabb when the alphabet is = = {a, b}. 
Knuth-Morris-Pratt algorithm for string matching : 
COMPUTE-PREFIX-FUNCTION (P) 

m < length [P] 

m1] <0 

k<0 
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forg<2tom 
do while k > 0 and P [k + 1] + Plq] 
dok <— x [hk] 
if P[k + 1] =P [q] 
thenk<k+1 
tiql<k 
10. return x 
KMP-MATCHER calls the auxiliary procedure COMPUTE-PREFIX- 
FUNCTION to compute z. 
KMP-MATCHER (T, p) 
n < length [T] 
m < length [P] 
m< COMPUTE-PREFIX-FUNCTION (P) 
q<0 
fori<lton 
do while g > 0 and P [q + 1] = Tli] 
doqg< x lq 
if P [gq +1] = TIi] 
theng<q+1 
ifqgq=m 
. then print “pattern occurs with shift” i —m 
q<zlql 
Numerical : 
pattern = ababbabbabbababbabb 
length 19 
Initially, m1) = Oandk=0 
For q<2to9 
For q=2andk}70 
P(0 + 1] * P[2]. 
m[2] = 0 
For q=3 
P(O + 1] = P[3] 
k=k+1=1 
m3] = 1 
For q=4k>0 
P{1 +1] = P[4] 
P[2] = PI[4] 
k=k+1=2 
m[4] = 2 
For q=5k>0 
P[2 +1] + P[5] 
m5] = 0 
For q=6 
P(0 + 1] = P[6] 


fo MANDO Pe 


SPoOorNIoarwnr 


a 
NPS 
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k=k+1=1 
m6] = 1 
For q=7k>0 
P{1 +1] = P[7] 
P[2] = PI7] 
k=k+1=2 
m[7] = 0 
For q=8k>0 
P(2 +1] = P[8] 
P(3] ¥ P[8] 
m8] = 0 
For q=9 
P(0 + 1] = P[9] 
k=k+1 
m9] = 2 
For q=10k>0 
P(2 +1] # P[10] 
n[10] = 0 
For q=11k>0 
P(0 +1)  P[11] 
m[11] = 0 
For q=12k>0 
P(0 + 1] + P[12] 
k=k+1 
n[12] = 2 
For q=18k>0 
P(2 +1) # P[13] 
n[13] = 0 
For q=14 
P(O + 1] = P[14] 
k=k+1 
n[14] = 2 
For q=15k>0 
P(2 +1] # P[15] 
n[15] = 0 
For q=16k>0 
P(0 + 1] + P[16] 
n[16] = 0 
For q=17 
P(0 + 1] + P[17] 
k=k+1 
n{17] = 2 
For q=18k>0 
P(2 + 1] + P[18] 
n[18] = 0 
For q=19 
P(0 + 1] + P[19] 
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What is an approximation algorithm ? What is meant by 
p(n) approximation algorithms ? Discuss approximation 
algorithm for Travelling Salesman Problem. 
Approximation algorithm : 

An approximation algorithm is a way of dealing with NP- 
completeness for optimization problem. This technique does not 
guarantee the best solution. 

The best of an approximation algorithm is to come as close as possible 
to the optimum value in a reasonable amount of time which is at 
most polynomial time. 

Let c(i) be the cost of solution produced by approximate algorithm 
and c*(z) be the cost of optimal solution for some optimization 
problem instance i. 

For minimization and maximization problem, we are interested in 
finding a solution of a given instance i in the set of feasible solutions, 
such that c(z)/c*(z) and c*(i)/ c(t) be as small as possible respectively. 
We say that an approximation algorithm for the given problem 
instance i, has a ratio bound of p(n) if for any input of size n, the 
cost c of the solution produced by the approximation algorithm is 
within a factor of p(n) of the cost c* of an optimal solution. That is 
max(c(i) / c*(Z), c*(t) / c(i)) < p(n) 

p(n) approximation algorithm : A is a p(n) approximate 
algorithm if and only if for every instance of size n, the algorithm 
achieves an approximation ratio of p(n). It is applied to both 
maximization (0 < C(i) < C*(i)) and minimization (0 < C* (i) < C(@)) 
problem because of the maximization factor and costs are positive. 
p(n) is always greater than 1. 

Approximation algorithm for Travelling Salesman Problem 
(TSP): 

The key to designing approximation algorithm is to obtain a bound 
on the optimal value (OPT). 

In the case of TSP, the minimum spanning tree gives a lower bound 
on OPT. 

The cost of a minimum spanning tree is not greater than the cost of 
an optimal tour. 

The algorithm is as follows : 

Find a minimum spanning tree of G. 
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2. Duplicate each edge in the minimum spanning tree to obtain a 
Eulerian graph. 

3. Find a Eulerian tour (J) of the Eulerian graph. 

4. Convert J to a tour T by going through the vertices in the same 
order of T, skipping vertices that were already visited. 


OOO 








